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Foreword 


The robot word was defined in the beginning of 1920 by the Czech writer 
Karel Capek as an artificial man. In this sense, the robot imitates a human, 
with feeling, reacting to stimuli of the surroundings, moving and performing 
mechanical work, and pretending thinking software. Robot is an artificial 
man or part of it, a humanoid robot, artificial organs, or artificial intelligence. 
This means that the use of the name biorobots is only a reminder of the 
biosource of inspiration and the biopurpose option of its application. 

A good example for bioinspired or bioapplied technology is using the 
neural network in computing methods (e.g., in decision-making systems) 
and—on other hand—using the wheel (not existing in natural organism 
motion systems) for robotics application. We can create robot drone inspired 
by the physiology of insects or birds or create medical transport devices based 
on wheels. We can use material technologies based on natural or artificial 
(e.g., shape memory alloys) components. 

By expanding the scope of inspiration (from human center), the robotics 
also gain knowledge about anatomical (mechanics), physiological, and brain 
(control) solutions from animal observation, or from the analysis of plant 
structure and understanding natural phenomena. For Leonardo da Vinci 
(a genius who wrote a lot, but did not publish any books, he painted a 
lot, but only completed a few paintings, designed military machines, but 
used them only in the theatre), creating robot solutions was a consequence 
of the cognitive passion, it was an attempt to answer the following questions: 
how a person moves, how a bird flies (studying and analyzing anatomy, 
physiology, behavior). 

At present, as a human being, we have moved our activity from the gro- 
und to a computer. From the natural world to the virtual one. Our activity is 
digital, so imitating human objects—bots—is another edition of robots. Bot 
specialist uses knowledge about the behavior of people to model and sim- 
ulate digital characters. These characters are not only the heroes of the 
new field of art (computer games, which are an interactive version of the 
story) but, soon, above all, intelligent, pretending people, service provider 
interfaces. For example (chatbots, kowbots, avatars, agents, etc.), it is infor- 
mant, hotel reception staff, our bank assistants, or a general practitioner. 

After the great progress in medicine of telecommunications (distance 
transmission of information), it is now time for the development of 
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teleaction (distance transmission of action, work). That means you need to 
use robots. A medical robot can be exactly there and when it is necessary, 
helpful, saving human lives or health. 

Medical robots work as a diagnostic robots (digital image diagnostics), 
surgical robots (reducing the invasiveness of surgery), welfare and social 
robots (increasing the quality of life of elderly), rehabilitation robots (con- 
trolled movement), rescue robots (in various environments), artificial 
organs, biorobots (used for cognitive purposes—neurophysiology, brain 
study, or social self-organization), educational medical robots (interactive 
patient simulators). 

The art of robotics is based on an intelligent combination of mechan- 
ical work and information management obtained by sensors. But among the 
solutions that can be used in medical applications, we have also fully 
mechanical devices—such as the designed by J.E.N Jaspers (Delft Univer- 
sity) surgical telemanipulator (Jaspers et al., 2007), digital devices (dr 
Bot), as well as attempt to create a biological-technical hybrid. 

Kevin Warwick, known as first human cyborg (after implanting an elec- 
tronic interface), claims (Warwick, 2013) that “where a brain is involved it 
must ... be seen ... as part of an overall system—adapting to the system’s 
needs.” Warwick is a pioneer in studying the connection between the bio- 
logical body and the robot. At Reading University, prof: Warwick’s team 
has done a research with the use of naturally cultivated neurons as brains 
controlling small mechanical systems. “In terms of ... learning and memory 
investigations are at an early stage. However, the robot can be seen to 
improve its performance over time in terms of its wall avoidance ability...” 
Warwick is considering robots with biological brains. This “approach allows 
for ‘complete body engineering’ in which brain size, body size, power, com- 
munications and other abilities are optimized for the requirements in hand.” 
He concludes, “Maybe this technique will ultimately open up a future route 
for human development whereby humans can cast off the shackles and lim- 
itations imposed by the restrictions of having to live in a biological body.” 

The integration of engineering and biology is a fact. This raises the ques- 
tion as to the borderline between a biological organism and a technical 
device. Where is the beginning of consciousness and intelligence? In my 
opinion, my answer is: beginning of consciousness is when the question 
“why” appears between the analysis of information from the environment 
and start the actions (Nawrat, 2011). Of course, for standard-based medical 
activities, the “why” question (between fact-based assessment, e.g., diagno- 
sis and action treatment) posed by a robot can be considered a system weak- 
ness. But that’s what people are. 
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I believe ethics to be the art of making the right choices. For ages, phi- 
losophers have been analyzing issues connected with the man-versus-man 
and man-versus-the world relations in order to help us comprehend the real- 
ity and find the correct conduct. Ethics and morality mutely assume a 
human-to-human contact. Now we have to solve a number of ethical prob- 
lems related to the fact that robots are among us, robots are moving, robots 
cowork with us (from robocars to robodoctors). The three laws of robotics 
proposed by I. Asimov are not enough. Perhaps a modification of the Dec- 
laration of Human Rights following the dissemination of robots will be 
necessary. 

With the harmonious development of technical and biological sciences 
and their reasonable implementation, we can influence the evolution of spe- 
cies and the quality of life on Earth. I’m not sure that women are from 
Venus, men are from Mars, but I’m sure that robots are from Earth. 

Let’s do it! Robots have to be created to multiply our freedom. 


Zbigniew Nawrat 

Assistant Professor, Department of Biophysics, School of Medicine With the Division of 
Dentistry, Zabrze, Poland 

Professor, Religa Foundation of Cardiac Surgery Development, Zabrze, Poland 
Director of Heart Prostheses Institute, Zabrze, Poland 

President, International Society for Medical Robotics, Zabrze, Poland 
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Preface 


Biomedical robotics and biomechatronics research operations can be traced 
back to the 1970s and 1980s. Biomedical robotics and biomechatronics 
research cover a variety of fast-growing interdisciplinary areas, including 
bioinspired robots for industrial, military, medical, and rehabilitation appli- 
cations. Biomedical robotics and biomechatronic devices are becoming a 
hot spot for research into technology and science. They have a methodolog- 
ical background in the fields of biomedical engineering and robotics, and are 
now applied to different engineers, basic and applied science, such as biol- 
ogy, neuroscience, medicine and humanities, as well as sociology, ethics, 
and philosophy. Knowledge acquisition of the biological system operating 
mechanism is a major objective of the study of biomedical robot systems 
and biomechatronic systems. As a consequence, the biological systems are 
frequently analyzed from a “biomechatronic” perspective. Knowledge is 
used to create technological and technological advancements that can lead 
to the development and construction, through the imitation of insects, pets, 
humans, and multiple lifetimes, of bioinspired devices and systems. 

In future generations of biomedical systems and apps, the combination 
of robotic technology and in-depth biomedical sciences is also promising. 
A strategy based on biomedical robotics and biomechatronics is of excellent 
concern, with three key objectives: (1) enhance knowledge of underpin- 
nings of sensing and acting in diverse animals, including our human beings; 
(2) build valid and helpful high-efficiency mechatronic and robotic systems 
and (3) develop efficient biological interactive systems, for example. 
Research into this direction clearly shows growing interest in humanoid 
technology; bioinspired and biomimetic robotics; human-robot coopera- 
tion and interaction; and biomechatronic endoscopy, intervention, aid, 
and recovery instruments. In addition to the growing importance of biolog- 
ical inspirational design in the advances in artificial structures, many appli- 
cations in mechatronics and robotics in different areas present fresh 
difficulties, both in theory and in technology. Therefore, the technologies 
and models used in design and manufacture of biomechatronic equipment 
and biologically inspired robots are very important for further development. 

We strive in this book (i) to highlight biomedical robotics and bio- 
mechatronical theoretical and practical problems; (ii) to bring together 
alternatives under distinct circumstances with particular attention to 
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validation of these instruments in biorobotic environments using practical 
tests; and (iii) to launch important case studies. 





About the book 


The new Elsevier book, Control Systems Design of Biorobotics and 
Biomechatronic with advanced applications, consists of 13 contributed chapters 
by subject experts who are specialized in the various topics addressed in this 
book. The special chapters have been brought out in this book after a rig- 
orous review process in the broad areas of biorobotics and biomechatronics. 
Special importance was given to chapters offering practical solutions and 
novel methods for the recent research problems in the mathematical model- 
ing and control applications of robotic systems. This book aims at showcas- 
ing the most exciting and recent advances in the application of biorobotics 
and biomechatronics in various fields and brings together a broad spectrum 
of topics covering various definitions, developments, control, and deploy- 
ment of biomechatronics/robot systems. 





Objectives of the book 


Through this book, we wish to deliver essential and advanced bioen- 
gineering information in applications of control and robotics technologies in 
life science. In the next few years, there will surely be much more exciting 
developments in this area. The first objective of this book is to focus on the 
engineering and scientific principles underlying the extraordinary perfor- 
mance of biomedical robotics and biomechatronics. The second objective 
is the application of the principles to design the corresponding algorithms 
that purposively operate in dynamic scenarios. 





Organization of the book 


This well-structured book consists of 13 full chapters. 





Book features 





¢ The book chapters deal with the recent research problems in the areas of 
biomedical robotics and biomechatronics. 

¢ The book chapters present various applications for biomedical robotic 
systems. 
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* The book chapters contain a good literature survey with a long list of 
references. 

* The book chapters are well written with a good exposition of the 
research problem, methodology, block diagrams, and mathematical 
techniques. 

¢ The book chapters are lucidly illustrated with simulations. 

* The book chapters discuss details of engineering applications and future 
research areas. 





Audience 


The book is primarily meant for researchers from academia and indus- 
try, who are working in the research areas—control engineering, biomedical 
engineering, electrical engineering, and computer Engineering. The book 
can also be used at the graduate or advanced undergraduate level as a text- 
book or major reference for courses such as Biorobotics, Biomechatronics, 
Selected topics in biomedical engineering, and many others. 
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CHAPTER ONE 


Human-robot interaction 
for rehabilitation scenarios 


Jonathan Casas, Nathalia Cespedes, Marcela Munera, 
Carlos A. Cifuentes 


Department of Biomedical Engineering, Colombian School of Engineering Julio Garavito, Bogota, Colombia 





1 Introduction 


Robots are being introduced in an increasing variety of domains. In 
such areas they are used as a tool for social assistance to help people in their 
homes, to be a guide in public spaces, as a teacher in classrooms, or as a coach 
in rehabilitative settings. In this direction, researchers worldwide are study- 
ing the social factors related to the human-robot interaction (HRI) in 
human environments and great attention is being focused on the cognitive 
human-robot interaction (CHRIJ) (Santis, 2007). In this chapter, we focus on 
robots as platforms, companions, and coaches for helping people to exercise 
and increase their physical abilities after suffering diseases regarding the car- 
diovascular and/or the neurological systems. 

As a brief introduction, the cardiovascular system allows the transport 
and delivery of nutrients, oxygen, hormones, and blood cells. In addition, 
it is a self-sealing circuit, that brings tools for repair and healing in case of 
damage. On the other hand, the nervous system coordinates actions by 
transmitting and receiving signals from several parts of the body. It consists 
of two main parts: the central nervous system (CNS) and the peripheral ner- 
vous system (PNS). The brain and spinal cord are part of the CNS and the 
PNS consists mainly of nerves, which connect the CNS to every part of the 
body. Those systems are susceptible to be affected by several diseases and 
disorders (see Fig. 1). Some of them will be introduced as follows. 

Cardiovascular diseases (CVDs) are known as disorders of the heart 
and blood vessels that include coronary heart disease, cerebrovascular 
disease, rheumatic heart disease, and other conditions (World Health 
Organization, 2018a). These diseases are referred to conditions that 
involve narrowed or blocked vessels and can lead to heart attack, stroke, 
and heart failure (American Heart Association, 2017). Two groups of CVDs 
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Neurological disorders Cardiac diseases 


Stroke Stroke 


Multiple sclerosis Heart failure 


Traumatic brain injury Coronary artery disease 


Spinal cord injury Congenital heart disease 


Guillain Barre syndrome Heart attack 


Fig. 1 Cardiovascular and neurological systems of the human body. Common cardio- 
vascular and neurological disorders are illustrated. 


are considered: (1) CVDs caused due to atherosclerosis, such as ischemic 
heart disease or coronary heart disease (heart attack), cerebrovascular disease 
(stroke), and diseases of the aorta and arteries that include hypertension and 
peripheral vascular disease; and (2) CVDs caused due to a different condi- 
tion, including congenital or rheumatic heart disease, as well as cardiomy- 
opathies and cardiac arrhythmias (World Health Organization, 2015). 
Among these groups, 70% of CVDs are caused by atherosclerosis (World 
Health Organization, 2015, 2018a). CVDs take the lives of 17.9 million 
people every year, an estimated 31% of all deaths worldwide (World 
Health Organization, 2018b). This situation affects quality of life, as 
demonstrated by 20% of patients who suffered a CVD event presenting 
prevalence of depression (Taylor et al., 2006). 

Moreover, neurological disorders are diseases of the central and periph- 
eral nervous systems, including the brain, spinal cord, nerves, neurological 
joints, and muscles, among others (WHO et al., 2006). Neurological dis- 
orders comprise an extensive group of heterogeneous (more than 600) 
pathologies, for example, spinal cord injuries, dementia, stroke, brain 
tumors, and multiple sclerosis (World Health Organization, 2016). As con- 
sequences of neurological disorders, upper and lower limbs can be affected, 
causing limitations within gait patterns and self-performance of the patients 
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in social, economical, and physiological contexts (WHO et al., 2006). 
According to the World Health Organization, neurological disorders con- 
tributed to 92 million disabilities in 2005, and it is projected that this will 
increase to 103 million in 2030 (approximately 12%) (WHO et al., 
2006). Within this group of diseases, stroke causes more than 6 million 
deaths each year (World Health Organization, 2016). 

Stroke survivors typically show significantly reduced gait speed, short- 
ened step length, and loss of balance in their gait patterns, and often 
experience falls (Potter et al., 1995). With the proven fact that repetitive 
and persistent stimulation could restore and reorganize defective motor 
functions caused by neurological disorders, there is a strong need for new 
therapeutic interventions (Johansson, 2011). 

This chapter aims to present the latest advancements in the area of social 
robots for rehabilitation scenarios that involve pathologies with high prev- 
alence worldwide, such as CVDs and neurological disorders. The main out- 
lines showed that the use of a social robot in rehabilitation scenarios has a 
positive impact reflected in the improvement of physiological parameters 
(e.g., heart rate [HR] and spinal posture patterns) and patients’ motivation 
to follow the treatment procedures. On the other hand, due to the moni- 
toring provided by the cHRI and the robot interaction, therapists were 
more focused on other rehabilitation tasks. 

This chapter is organized in five thematic sections, addressing relevant 
aspects regarding social robots for rehabilitation scenarios and the important 
interaction aspects involved in this process. 

Section 2 addresses the literature review concerning social robotic agents 
(SARs), paying special attention to the interfaces that have been implemented 
or can be useful for applications in rehabilitation and health care. 

Section 3 begins with the definition of human-robot interfaces and the 
proposed robot-based therapy model. Afterward, the current state of reha- 
bilitation is described. Finally, cCHRIs are presented in the context of cardiac 
and neurological rehabilitation (NR). 

Section 4 addresses two experimental studies presented in this chapter: a 
cardiac rehabilitation (CR) longitudinal study and a study for NR based on 
repeated measurements. 

Section 5 discusses the model developed for social HRI in the context of 
rehabilitation scenarios and analyzes outcomes obtained during the robot- 
therapy interventions. 

Finally, Section 6 presents the conclusions and some recommendations 
for future works in this challenging field of rehabilitation robotics. 
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2 Related work 


Socially assistive robotics (SAR) is the field dedicated to the develop- 
ment of robots that provide feedback, instructions, encouragement, and 
emotional support through social interaction to increase patients’ motiva- 
tion and performance within the therapies. SAR has been initially defined 
as the combination of assistive robotics (AR) and social interactive robotics 
(SIR). In the first place, SAR and AR are meant to provide assistance to 
human users. However, in SAR, this assistance is specifically achieved by 
means of social interaction with the user. From this perspective, SAR and 
SIR have the same goal, as they are focused on developing social interaction 
strategies that enable them to exhibit a closer and more effective interaction 
with the human user. Unlike SIR, the scope of SAR is limited to achieve 
major progress in the areas such as rehabilitation, health care, etc. (Feil-Seifer 
and Mataric, 2005). 


2.1 Social robotic agents 


The main role of SARs, or social robots, is to act as companions or assistants 
in a specific task. In rehabilitation and healthcare environments, social robots 
are regarded as training assistants, coaches, or motivator agents that help 
improve patients’ performance or increase engagement during the therapy. 
With this in mind, social robots are required to contain a series of features 
that allow them to interact in an effective way, providing adaptability and 
flexibility to human environments. As these agents are designed to interact 
socially with humans, they must exhibit human-like behaviors and their 
appearance and functionality must be structured in a way that humans 
can interpret and be familiarized with Fong et al. (2003). 

In this context, a considerable aspect that enables an effective social inter- 
action is the physical embodiment, which allows the robot to perceive and 
experience the physical world. Hence, it will be able to interact with humans 
and engage with their activities in a more natural and intuitive way (Wainer 
et al., 2006b). The embodiment is a term considered to refer to the fact that 
intelligence cannot be limited to exist in the form of an abstract algorithm, 
but requires a physical instantiation or body (Pfeifer and Scheier, 1999; 
Dautenhahn et al., 2002). Different studies have demonstrated the effect 
and benefits that embodiment attributes to the robotic platforms over other 
types of social agents, such as virtual agents and screen-based avatars. It has 
been demonstrated that social robots receive more attention and the 
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interaction with the users can be more engaging (Belpaeme et al., 2013; 
Powers et al., 2007; Wainer et al., 2006a). 

Although all social robots are embodied (have a physical body that allow 
them to interact with the world), the degree of interaction may vary 
depending on the capabilities of the robot. Hence, a robot with more motor 
and sensor skills will present more capabilities to interact with the environ- 
ment as it can establish more relationships with the world. Currently, there is 
a wide spectrum in the design features that social robots have. In this chapter, 
we consider the classification of social robots in two main categories: (1) 
Real/Abstract, which indicates the degree of similarity that the platform 
has with the nature (i.e., how similar the robot is to a living being), unlike 
the abstract design; and (2) Animal/Human, which describes their similarity 
to a human being or an animal creature. Fig. 2 illustrates some robots that 
are conventionally used. As can be observed, these platforms vary in their 
shape and appearance. 

Although all these platforms can be regarded as SARs, their functional- 
ities and field of applications can diverge, as each robot can be suitable for a 
specific task and a specific degree of interaction. 


Human-like 





Kaspar 





Real 





Abstract ro) 


— 
Jibo Keepon 


Aibo Pleo 








Animal-like 
Fig. 2 Socially assistive robots classification. In this chapter we consider two main cat- 
egories: Real/Abstract, referring to their similarity to living beings, and Human/Animal, 
referring to their similarity to humans or animals. 
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As every day more robotic platforms are designed, the application spec- 
trum of SAR is expanding in a similar way, covering multiple areas in 
healthcare and rehabilitation scenarios. The next section presents a detailed 
overview of the applications and the relevant findings associated with this 
research. 


2.2 Applications in rehabilitation and healthcare 


SAR was initially explored in cardiovascular therapies with the development 
of CLARA, a hands-off physical therapy assistant whose aim was to reduce 
the effects of nursing shortages, provide motivation, and aid patients through 
the rehabilitation exercises as spirometry therapies. In this study, the 
researchers found high expectations over the robot’s usefulness and an aver- 
age overall satisfaction of the population of about 80% (Kang et al., 2005). 
Furthermore, SAR has been used in several applications focusing on elderly 
care (Bemelmans et al., 2012), dementia, mental health treatments (Rabbitt 
et al., 2015; Martin et al., 2013), and physical and poststroke rehabilitation 
(Matari¢ et al., 2007). Within elderly care areas, robots such as PARO were 
used in therapeutic scenarios, in order to achieve social exchanges and 
encourage patients during exercises (Marti et al., 2006). The study opens 
interesting perspectives about the use of a robot as a nonpharmacological 
therapeutic aid. It has been found that PARO was able to support the com- 
plexity ofa clinical scenario in a flexible way allowing patients’ engagement 
and sociorelational exchanges. In addition, effects such as the improvement 
of communication, cognitive skills (Tsardoulias et al., 2017), and reduction 
of anxiety (Louie et al., 2014) in elderly populations have been observed, 
showing in general positive attitudes toward social robots. 

Another domain that has been broadly approached by SAR technology is 
poststroke rehabilitation. Autonomous robots (Matari¢é et al., 2007; Mead 
et al., 2010) and embodied agents (Jung et al., 2011) have been explored 
to monitor and supervise poststroke survivors during gait training and 
upper-limb exercises. The studies showed a positive impact within the users 
on their willingness to perform prescribed rehabilitation, changes in the 
motor functioning, and improvements in the average number of trials 
accomplished per minute. 

Finally, physical training and coaching are areas of interest in social 
robotics as robots can be used as companions to guide different kind of 
exercises and improve the adherence to this programs using cognitive 
approaches. As an example, NAO robots were implemented into conven- 
tional physiotherapy practices in order to guide several body movements 
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(Lopez Recio et al., 2013) and in upper-limb exercises for patients with phys- 
ical impairments, such as cerebral palsy and obstetric brachial plexus palsy 
(Pulido et al., 2016). The results have demonstrated an accurate monitoring 
of the therapies, and fluent interaction with the robot. In addition, patients 
like to follow the exercises provided by the NAO and engage with the reha- 
bilitation trying to perform the tasks (Pulido et al., 2016). In 2008, a long-term 
study showed the effects of HRI in coaching with the aim of reducing the 
rates of overweight and obesity. In this case, the robot asked patients their diet 
goals in terms of burning calories during exercise and data related to the food 
consumed during the day. The results showed that the participants assisted by 
the social robot were more interested in knowing their calorie consumption 
and exercise performed than those who used other methods (Kidd and 
Breazeal, 2008). 

Adherence is an important factor to achieve exercise adoption, and dif- 
ferent studies have shown positive results regarding this factor. Gadde et al. 
(2011) evaluated in the early stages an interactive personal robot trainer 
(RoboPhilo) to monitor and increase exercise adherence in older adults. 
The system was proved with 10 participants, showing initially a positive 
response and a favorable interaction. A complementary application where 
robots are being used to motivate and increase adherence in long-term ther- 
apies and medical self-care is diabetes mellitus treatments, where robots play 
the role of personal assistants to adults (Looije et al., 2006) and children 
(Baroni et al., 2014). This has shown potential results within motivational 
aspects and treatment engagement. 

Summarizing, several authors have described SAR systems in terms of 
aiding patients in different areas showing great potential and results. This 
research focuses on deploying a social robot into cardiovascular and NR 
scenarios to provide monitoring and motivation during therapeutic 
treatment. 





3 Human-robot interfaces for rehabilitation scenarios 


Human beings interact with the environment through cognitive 
processes, sequences of tasks that include reasoning, planning, and finally 
the execution of a previously identified problem or goal. From this process, 
the robots may use information regarding human expressions and/or phys- 
iological phenomena to adapt, learn, and optimize their functions, or even to 
transmit back a response resulting from a cognitive process performed within 
the robot. This concept is named the cHRI (Pons et al., 2008). 
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cHRI systems often present bidirectional communication channels. On 
the one hand, robot’s sensors measure the physiological parameters, human 
actions, and expressions. On the other hand, the actuators transmit 
the robot’s cognitive information (social interaction) to the user. In other 
words, the user observes the state of the system through feedback sent im- 
mediately after the user command is executed. This configuration performs 
a closed-loop HRI in order to develop a natural cooperation during the 
rehabilitation task. 

Humans perceive the environment in which they live through their 
senses: vision, hearing, touch, smell, and taste. They act on the environment 
using their actuators, for example, muscles, to control body segments, hands, 
face, and voice. Human-to-human interaction is based on sensory perception 
of actuator actions. A natural communication among humans also involves 
multiple and concurrent modes of communication (Sharma et al., 1998). 

The goal of effective interaction between a user and their robot assistant 
makes it essential to provide a number of broadly utilizable and potentially 
redundant communication channels. This way, any HRI system that aspires 
to have the same naturalness should be multimodal. Different sensors can, in 
that case, be related to different communication modalities (Sharma et al., 
1998). The integration of classic human-computer interfaces (HC1i) like 
graphical input-output devices, with newer types of interfaces, such as 
speech or visual interfaces, tactile sensors, laser range finder (LRF) sensors, 
inertial measurement units (IMU), and physiological sensors, facilitates 
this task. 


3.1 Proposed robot-based therapy model 


The robot-therapy model proposed in this chapter is illustrated in Fig. 3. 
This schema considers two main components: (1) Motivation, which aims 
to provide intrinsic and extrinsic motivation, and (2) Therapy control, focused 
on the monitoring of the therapy performance, the management of warning 
events, and reduction of risk factors that can lead to emergencies. Each ther- 
apy has risk factors associated with the tasks that are performed. The model 
seeks to manage and reduce these risk factors while monitoring the devel- 
opment of physiological and spatiotemporal parameters that are relevant to 
each scenario. This goal is achieved by means of custom multimodal sensor 
interfaces that provide all relevant information to be processed by the social 
robot. Hence, the robot is able to generate feedback to the user appropriate 
to the context and the therapy conditions. 
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Fig. 3 Proposed robot-based therapy model. This model considers two main compo- 
nents: motivation and therapy control as the main features that the social robotic agent 
exhibits during the therapy. 


The remainder of this section presents in detail both scenarios, cardiac 
and NR, where a social robotic platform was deployed in the framework 
of the model previously described. 


3.2 Rehabilitation scenarios 


Considering the robot-based therapy model described earlier, two inter- 
ventions were carried out. The first intervention with a social robot was held 
in the CR service. Subsequently, this work has been extended to the NR 
scenario. This section describes the corresponding clinical context, in which 
the system was deployed, followed by the proposed custom cHRI designed 
for each application. 


3.2.1 Current state of cardiac rehabilitation 

CR programs are designed to prevent CVDs or to treat a patient after a car- 
diovascular event. CR covers different areas, such as nutrition, physical 
exercise, and health education. Even though these programs have proved 
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successful in reducing and preventing the occurrence of a posterior cardio- 
vascular event, the adherence associated with the program does not reach a 
desirable level. Multiple studies have demonstrated the low adherence rates, 
which are not higher than 50%, and the implications that this situation has in 
the health condition of patients (Bethell et al., 2011; Sarrafzadegan et al., 
2007; Worcester et al., 2004). 

Different studies have evaluated the adherence in rehabilitation programs. 
From these studies, it has been found that patients are more likely to attend the 
programs when physiotherapists encourage them during the sessions and feel 
satisfied with the therapy. Likewise, when there is a perceived interest by the 
therapist and patients feel a sense of complete supervision, their performance 
and results tend to increase (Essery et al., 2017; Jackson et al., 2005). In this 
context, it is clear what role the continuous monitoring and encouragement 
of the medical staff plays in the success, in terms of adherence and perfor- 
mance, of patients attending to the rehabilitation therapies. Therefore, the 
work presented in this section focuses on the development ofan assistive tool, 
based on SAR, that supports the work carried out by clinicians and aims to 
offer a more personalized service to the patients, through continuous mon- 
itoring, motivation, and companionship within the CR therapies. 

Before introducing the proposed SAR system, it is worth mentioning the 
structure that a conventional CR program has. The structure and compo- 
nents differ depending on the country and institution. However, they tra- 
ditionally consist of three phases: inpatient (phase I), outpatient (phase II), and 
community maintenance (phases III and IV). The outpatient phases, namely 
phases II and III, take place in a specialized center or institution and are 
carefully performed under the supervision of healthcare providers with 
monitoring based on exercise tolerance test results (Kim et al., 2011). 
Our work has been focused primarily on phase II of the CR programs. 
The features and structure of this phase are described in following sections. 


Phase Il 

This phase is the first outpatient phase and begins immediately after the 
patient leaves the hospital. It consists of a combination of physical exercise 
on a treadmill and an education program oriented to prevention of risk fac- 
tors, as well as adoption of healthy habits (e.g., controlling blood pressure, 
cholesterol, weight and stress management). This phase has an average dura- 
tion of 3 months and is designed to provide a safe monitored environment 
for exercise. The monitoring consists of measuring the patient’s blood pres- 
sure, HR, and eventually heart and lungs sounds. Additionally, it is 
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important to monitor the perceived exertion level (.e., fatigue or effort dur- 
ing the exercise). This measurement is carried out with the Borg Scale (BS), 
which is a qualitative measurement that estimates the perceived exertion of 
the patient (6 for low intensity and 20 for very high intensity). As a result 
from phase II, the patient should be able to self-monitor their physiological 
parameters and exertion levels. This aspect will return the confidence to 
the patient to continue a normal life, being aware of their health condition 
and the healthy lifestyle that is required to prevent a second cardiac event 
(Scherr et al., 2013). 

Taking into account the CR context, as well as the structure of phase IJ, 
where the intervention takes place, a cHRI is proposed. This interface 
has been designed taking the adherence, motivational aspects, and therapy 
structure into consideration. 


3.2.2 Cognitive human-robot interface proposal for CR 

The design of the cHRI for CR has been carried out by means of different 
stages. In the first place, the system was developed and evaluated under 
laboratory conditions (Lara et al., 2017). As a second stage, the system 
was deployed at the clinic (Fundacién Cardioinfantil-Instituto de Car- 
diologia) and tested with a real patient during normal therapy. Results of 
this intervention are presented in a subsequent work (Casas et al., 2018). 
Finally, the system was deployed for a larger number of patients during 
the complete phase I of the CR program. This section describes the struc- 
ture and components that conform the interface. 


System modules 

There are three main modules that comprise the system. A sensor manager is 
designed to handle the acquisition and recording of all the sensory data gen- 
erated by the system. The HCi is incorporated to provide the possibility to 
interact with the information of the system, and finally the SAR responsible 
for acquiring the sensory information and providing appropriate feedback to 
the user during the therapy. The system is illustrated in Fig. 4, where the 
robot receives as input all the data generated by the sensors and the HCi, 
and provides feedback through social interaction according to the informa- 
tion processed. These modules are described later. 


Sensor manager 
The sensor manager is designed to measure two types of variables: physio- 
logical and spatiotemporal. Physiological variables are acquired by means of a 
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Fig. 4 Cognitive human-robot interface for cardiac rehabilitation. In this scenario, 
patients perform physical activity on a treadmill, while the sensor interface records their 
physiological and spatiotemporal parameters to be processed and analyzed by the 
socially assistive robot. The results of this analysis are provided to patients as feedback 
by means of social interactions. 


HR monitor Zephyr HxM BT (Medtronic, Minneapolis, USA) attached to 
the chest of the patient (see Fig. 4). This sensor provides information about 
the HR variability and its evolution. The spatiotemporal variables are 
acquired with a LRF URG-04LX-UG01 (Hokuyo, Japan) that is placed 
in front of the patient to measure their legs. From this measurement, it is 
possible to obtain the speed, cadence (number of steps per second), and step 
length. Finally, an IMU sensor MPU9150 (Invensense, San Jose, CA, USA) 
is placed on the treadmill surface to measure the inclination of the band. This 
variable is associated with the exercise intensity. 


Human-computer interface 

This interface has been designed with two purposes. In the first instance, the 
interface allows the patient to observe the acquired sensory data during the 
therapy. Likewise, this system serves as a means of communication between 
the robot and the user. Thus, qualitative measurements such as the exertion 
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rate (BS) can be delivered through the interface when the robot has 
requested these. Similarly, the patient has the capability to report an emer- 
gency or any anomaly during the session. 


Social robotic agent 

As shown in Fig. 4, the robotic platform that was incorporated in the system 
is the social humanoid robot NAO (SoftBank, Tokyo, Japan). According to 
the robot-therapy model previously defined in Section 3.1, the robot 
exhibits three main behaviors (i.e., motivation, warning, and emergency). 
In order to design behaviors that were familiar to the patients, our study con- 
sidered an observation phase, where key therapist-patient interactions were 
identified. During this phase, it was possible to define the social features that 
the robot should exhibit, to ensure an effective communication. The robot’s 
behaviors have been designed to be autonomous (e.g., no human interven- 
tion is required to trigger any of the behaviors). 

The Motivation behavior 1s based on verbal expressions that are generated 
by the robot in different moments during the therapy. With these expres- 
sions, it is expected to provide encouragement and engage the patient with 
the exercise. The Warning behavior is designed to handle a potential occur- 
rence of any of the risk factors associated with the therapy. In this case, two 
risk factors are carefully monitored: sudden increase of HR and risk of falling 
due to dizziness and bad posture. These risk factors are evaluated by means of 
the analysis of the HR sensory data and the image processing to identify 
appropriate postures. Finally, the Emergency behavior is adopted when one 
of the considered risk factors occurs or when the patient reports an unusual 
condition. In this scenario, the robot requests the immediate intervention of 
the medical staff to control the situation. 

Evidence of a real intervention in the clinic can be observed in Fig. 5, 
where a real patient performs physical activity on the treadmill with the 
social robot acting as companion and assistant. As shown in the figure, 
the patient has access to the HCi that is placed on the front panel of the 
machine. Thus the patient can interact with the robotic system while per- 
forming the rehabilitation session as usual. Similarly to the CR application, 
the NR context, as well as the proposed cHRI for this scenario, is presented 
in following sections. 


3.3 Current state of neurological rehabilitation 


The World Health Organization defines physical rehabilitation (PR) as an 
active process to achieve a full recovery or, if full recovery is not possible, 
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Fig. 5 Robot therapy for cardiac rehabilitation at Fundacion Cardioinfantil-Instituto de 
Cardiologia (FCI-IC). 


to reach optimal physical, mental, and social potential to integrate people 
appropriately into society (WHO et al., 2006). 

As a comprehensive strategy, PR has two approaches: (1) improve 
physical aspects of patients as cardiovascular functioning, aerobic capabilities, 
muscles functioning, and gait patterns during physical activity, and (2) 
improve cognitive aspects related to the cognition processes that include 
language, perception, motivation, and attention among others. These 
approaches are important to assess the patient’s long-term performance 
and achieve a full recovery and a successful rehabilitative process. 

Within PR methods, conventional and robot-assisted therapies can be 
found. The conventional therapeutic scenario is guided by a therapist and 
repetitive exercises are used to improved patient performance (Fisher 
et al., 2011): the results of conventional therapy depend on the expertise 
of the medical group and the intensity of the sessions (Hussain et al., 
2011). Body weight support (BWS) treadmill training is one of multiple 
techniques used in neurorehabilitation. BWS combines recent findings that 
promote functional locomotor recovery and practices where the patient has 
to perform complete gait cycles at an early stage of gait rehabilitation 
(Werner et al., 2002; Winter, 1989). During the training, patients are 
mechanically supported in a harness to substitute the deficit of equilibrium 
reflexes and support a proportion of their body weight so that subjects can 
carry their remaining weight adequately (Winter, 1989). This method has 
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shown improvements in spatiotemporal and kinematic gait parameters 
(Visintin et al., 1998). 

On the other hand, robot-assisted therapy for gait rehabilitation combines 
BWS systems and a exoskeleton to train and recover gait patterns in patients 
with neurological limitations. Currently, a gold standard device in this type of 
therapy is Lokomat. This is a robotic device that adjusts to the lower limbs of 
the user to retrain the gait by means of neuroplasticity stimulation, intensive 
and effective exercises which enable optimal recovery (Hocoma, 2019). 
Different studies have shown the benefits of using Lokomat rather than con- 
ventional treatment. Husemann et al. (2007) showed that the Lokomat train- 
ing increases muscle tissue and reduces fat mass in stroke patients. In addition, 
parameters such as cardiovascular functioning and oxygen uptake during the 
exercise (Krewer et al., 2007), muscular tone (Mayr et al., 2007), balance 
(Bang and Shin, 2016), motor control (Banz et al., 2008), and gait speed 
(Hwang et al., 2017) improved with the use of Lokomat. 

In this context, some studies have presented concerns regarding Lokomat 
therapy, such as (1) lack of adherence to the programs, as around 42% of the 
patients deserted PR programs (Jack et al., 2010), and (2) the multitasking 
processes performed by the therapist during a session (Douglas et al., 2017; 
Munera et al., 2017). In healthcare areas, Appelbaum et al. (2008) demon- 
strate that multitasking processes have disadvantages, such as increasing time 
to task completion, stress, memory lapses, errors (Pashler, 2000), and acci- 
dents. We performed a previous study, where we found that Lokomat therapy 
requires parallel assistance of the medical group all the time. A session includes 
tasks such as device configuration, patient preparation, giving feedback to 
patients, assessment of gait performance, teaching, etc. 


3.3.1 Cognitive human-robot interface proposal for NR 

The design of CHRI for NR follows different stages. In the first place, initial 
observations at the clinic (Clinica Universidad de La Sabana; Fig. 7) were 
made in order to establish physiological and cognitive measurements 
according the needs and the interest of the medical and engineering team. 
In the second stage, a short-term study tested real patients during Lokomat 
sessions. 


System modules 

Similarly to cardiac CHRI, in NR there are three main modules that describe 
the system. A sensor manager module is used to acquire and record all the 
sensory data generated by the system. The HCi visualizes the data obtained 
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during the session, and finally the SAR’s role is to interpret the sensory data 
and give feedback to the patient to motivate and improve patient perfor- 
mance within the therapy (Fig. 6). These modules are described here. 


Sensor manager 

This module records two variables: HR, essential to know the level of 
fatigue and the physical activity response (Achten and Jeukendrup, 2003); 
and spinal posture in order to monitor proper dynamic posture— 
maintaining this posture helps to promote back health, allows muscles to 
work properly, and decreases muscle fatigue (Bradley, 2004; Weaver and 
Ferg, 2010). For the HR measurement, the same sensor mentioned in 
Section 3.2.2 was used. Finally, two BNO055 IMUs (Adafruit, New York, 
USA) were used to measure cervical and thoracic inclination angles at pitch, 
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Fig. 6 Cognitive human-robot interface for neurological rehabilitation. The patient per- 
forms the assigned task with the support of a robotic platform, while the socially assis- 
tive robot receives the information generated by the sensor interface and the human- 
computer interface to interact subsequently with the patient through social 
interventions. 


Human-robot interaction for rehabilitation scenarios 17 





roll, and yaw rotations. The configuration of the IMUs’ position determines 
the body planes. In this case, the sagittal plane corresponds to the pitch axis, 
transversal plane to roll axis, and coronal plane to yaw axis. One sensor was 
located on the user’s forehead and the other one between the T6 and T7 
spinal segments adjusted with velcro straps (Kim et al., 2013). 


Human-computer interface 

The HCi is used to visualize the data of the sensors, control the therapy 
acquisition times, and show the BS. According to the observations, the 
BS is represented with a range of 0-10, where 0 means a low level-fatigue 
perception and 10 a high-level fatigue perception. 


Social robotic agent 

The SAR approach was designed following the next robot roles: (1) motivate 
the patient to perform rehabilitation tasks as aerobic and anaerobic exercise, 
(2) monitor the patient’s performance, and (3) provide feedback according to 
the parameters extracted from the sensory interface. The behaviors of robots 
are several routines depending on the patient’s performance and the data 
acquired by the sensor manger module. As general actions, the robot has 
programmed greetings at the start and the end of each session where it presents 
itself and explains its tasks within the rehabilitation process. On the other 
hand, the feedback given by NAO is based on five routines. For cervical posture 
feedback and thoracic posture feedback, the robot performs verbal gestures and 
nonverbal actions to correct the patient (e.g., the robot tilts its head down 
and imitates the patient; then the robot shows the patient how to reach a 
healthy cervical posture). In the case of the HR alert, the robot uses verbal 
phrases to give advice to the therapist when this parameter exceeds a permis- 
sible threshold according to the medical prescription. Finally, the BS request 
and motivational feedback are given verbally to the patient by the robot in order 
to know the fatigue perception and to promote a proper posture. This moti- 
vational feedback is given randomly during the session. 

Evidence of the intervention can be observed in Fig. 7, where a patient 
performs Lokomat-based therapy with an NAO robot. As shown in the fig- 
ure, the patient has a sensory system to measure posture and an HCi that 
allows the therapist to visualize the data based on the previous cHRI pres- 
ented for cardiac and NR. 

The next section describes the experimental studies that were carried out 
in real scenarios, aiming to evaluate and validate the effect of SARs in these 
clinical contexts. 
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Fig. 7 Integration of an NAO robot in conventional therapy for neurological rehabilita- 
tion using Lokomat at Clinica Universidad de la Sabana. 





4 Experimental studies 


Following the same structure of the previous section of this chapter, 
this section presents, in the first place, the experimental study carried out for 
CR at FCI-IC. Subsequently, the experimental study deployed in the NR 
scenario is described. 


4.1 Cardiac rehabilitation longitudinal study 


In order to address the hypothesis stated in the human-robot interfaces pro- 
posed before, a longitudinal study is conducted. The system was tested dur- 
ing phase II of the CR program and each participant was for 18 weeks 
attending the sessions twice a week. In this study, the performance of the 
system was compared to a control group where the measurements were 
taken but the patient did not have any feedback. The purpose of this 
condition is to measure the performance of the patient during the therapy, 
without interfering with or altering the normal conditions of the session. 


4.1.1 Experimental procedure 

A standard session procedure divided in five stages was defined for the exper- 
iments (1.e., Init, Warm-Up, Treadmill Exercise, Cool-Down, and End). During 
these stages some physiological measurements are taken by the system or the 
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medical staff. The interaction with the robot is mainly done in the treadmill 
exercise. During this stage, most of the interventions are present since the 
system provides motivation, requests the BS, and monitors all the events asso- 
ciated with warnings and emergencies. 

The performance of the patients during the session was measured with 
quantitative variables related to the nonattendance rate, physiological variables, 
and interaction variables. The nonattendance rate indicates the number of 
absences of the participants during the study. The physiological variables 
are the resting HR, which is the HR level measured without any physical 
activity, and the recovery HR, measured a minute after the end of the activity 
during the cool down. The interaction variables quantify the interaction 
between the patient and the system through two measurements: the response 
time (RT), which is the time (in seconds) between the robot’s request for the 
BS and the patient’s response, and the posture corrections, which express the 
amount of posture corrections that the robot requests of the patient. The 
patient’s perception of the system was also important for the assessment 
and was obtained using a semistructured interview carried out at the end 
of the study. The questions are focused on gathering personal opinions 
and impressions of the system. 


4.1.2 Results of the study 

The study took place in a real clinical context throughout the complete 
phase II of the rehabilitation program. During this period, it was possible 
to evidence the impact that social assistive robots could generate in cardiac 
patients. According to the measurements considered during the study, there 
are some important aspects that are worthy of mention. 

In the first place, the performance of the therapy was successfully mea- 
sured and evaluated by means of the sensor interface previously described. As 
illustrated in Fig. 8, a sample of data recorded during one therapy is pres- 
ented. Plot (a) shows the HR of one patient during the session. Plots (b), 
(c), and (d) represent the spatiotemporal parameters (speed [m/s], step length 
[m], and cadence [steps/s]). The inclination of the treadmill is plotted in dia- 
gram (e), and finally the BS values requested during the session are plotted in 
diagram (f). Additionally, two events are highlighted (A and B). Event 
A indicates when the therapists increment the exercise intensity (the speed 
and slope of the treadmill are modified). It can be observed that before this 
event the patient presented a low level in almost all their parameters, as well 
as the self-perception of the intensity estimated with the BS. However, once 
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Fig. 8 Patient's data registered during a CR session. (a) Heart rate, (b) speed, (c) step 
length, (d) cadence, (e) inclination, and (f) BS. 
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the exercise parameters increase, the data recorded similarly reflect the incre- 
ment as the HR and the spatiotemporal change with an increasing rate. 
Event B occurs when the exercising time has concluded and patients must 
step out the treadmill and perform the cool-down routine. As displayed in 
Fig. 8, after this event only the HR is monitored, since this variable is used to 
measure the patient’s recovery. Thus, during the first minute of cool down, 
the HR difference is measured to estimate the rate at which the cardiovas- 
cular system returns to the resting point. 

On the basis of the information that the sensor interface is able to record 
during the therapy, throughout the study it was possible to perform on-time 
assistance and monitoring of the therapy. Hence, the SAR provided contin- 
uously the appropriate feedback according to the context and the physiolog- 
ical conditions. In this way, it was also possible to reduce potential 
occurrence of risk factors, as the robot had access to the immediate state 
of patients to provide corrections and assistance. 

Considering the multiple interactions that patients had with the robot 
during the therapies, it was possible to draw some metrics that could provide 
information about the progress in terms of the patient-robot interaction. 
Therefore, two variables were considered (i.e., adaptation and correction). 
The adaptation seeks to evaluate the patient’s response to requests provided 
by the robot. In this case, adaptation was designed to be measured for the BS 
request. Patients must deliver their BS value through the HCi when the 
robot requests it. Hence, adaptation was measured as the time in seconds that 
patients spent delivering this value after the request. Results of this measure 
are illustrated in Fig. 9, where a decreasing rate of the RT is observed. In 
other words, patients take less time to deliver the value requested by the 
robot throughout the sessions, which is related to the adaptation that they 
have to the system and the interaction with the robot. 

On the other hand, the correction was considered when the patient’s pos- 
ture was not ideal. This issue can generate dizziness, being likely to fall from 
the treadmill. In this way, during the study it was possible to quantify the 
amount of interventions related with the posture correction that took place 
along the sessions. In this period, it was also possible to perform over 50 cor- 
rections that clinicians could not monitor, due to the considerable volume of 
the therapy groups. Thus, the SAR system has proven to be an appropriate 
assistance tool that can support clinicians in their activities within the ther- 
apy. Likewise, the safety of patients during exercise can increase thanks to 
the continuous monitoring. 
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Fig. 9 Adaptation. 


4.2 Neurological rehabilitation repeated measurements study 


For the assessment of the NR interface proposed, a repeated measurements 
study was designed. In this study, the performance of the system was com- 
pared to the same patients with and without the robot. Without the robot 
the measurements were taken, but the patient had feedback only from 
the therapist. The purpose of this condition is to measure the performance 
of the patient during the therapy time (30 min), without interfering with or 
altering the normal conditions of the session. 


4.3 Experimental procedure 


The patients were asked to participate in a short-term study consisting of two 
sessions: one with the robot and one only with the measurement system. 
Without the robot the feedback is given only by the therapist, aiming to 
be similar to a session without any external intervention. The participants 
were users of Lokomat during their PR process and none of the patients 
had alterations in cognitive function that do not allow the understanding 
of the instructions and the NAO’s behavior. 

To assess the system, four parameters were taken into account. The bad 
posture time measures the time when the posture degrees overcome the good 
posture threshold. The HR and BS give an indication of the cardiovascular 
function. Finally, the perception of the patients and therapist was measured 
using a survey. 


4.4 Results of the study 


Regarding the human-robot interface for NR, four patients participated 
in the experimental study, and four parameters (i.e., HR, cervical posture, 
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thoracic posture, and BS) were measured. According to the experimental 
design study mentioned in Section 4.2, the functionality of the interface 
was observed during 30 min of therapy. As an initial observation, the inter- 
face worked correctly in the sessions; the data was acquired online and saved 
in the database. 

Regarding the data acquisition, the results of this section present the gen- 
eral behavior of the data recorded during a control session and the effects of 
the robot over this parameters. Fig. 10 shows the evolution of cervical and 
thoracic posture and BS of one patient during both scenarios. As it can be 
seen, the inclinations of the spinal cord were more noticeable at pitch axis 
(sagittal body plane) for both areas (thoracic and cervical sections) than yaw 
and roll axes; this behavior occurs due to the mechanical features of Lokomat 
that limit the movement of the patient’s torso. Lokomat has a BWS system 
that allows a partial control of the body; rotations at the coronal (yaw axis) 
and transversal (roll axis) body planes are slightest. 

On the other hand, to measure bad posture we establish a threshold that 
represents the maximum permissible degrees (10-15 degrees over 0 degree) 
of inclination in both areas, taking into account that a proper posture is 
reached when the patient has minimal inclinations during the gait training 
with Lokomat. Comparing between cervical and thoracic posture, we 
notice that cervical posture exceeds the threshold more times than the tho- 
racic posture. This occurs because the head does not have any support, 
unlike the thoracic area. Concerning the HR and the BS, the results showed 
a constant behavior, as Lokomat sessions are not highly intensive, the 
patient’s HR does not increase to a high value, and the perception of the 
fatigue corresponds to a neutral level in both cases (control and robot- 
assisted sessions). 

During the control sessions we can observe that the tasks of the 
therapist were multiple and the corrections of the posture were not followed 
with accuracy due to this situation. As a consequence of these multitasking 
processes, the time where the patient kept a bad posture increased (Fig. 10A 
and D). The main aims of the robot within NR were to reduce therapist 
tasks and assist the patient by monitoring the parameters discussed before. 
The effects of using SAR in NR in this short-term study can be seen in 
the results obtained during the robot session. In this case, the time of 
bad posture in both areas (cervical and thoracic) decrease (Fig. 10B and E) 
compared to the control session (Fig. 10A and D). For the robot condition, 
the patient accomplished a proper posture more times than a control session. 
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Fig. 10 Patient data registered during a Lokomat therapy. Thoracic posture at (A) pitch 
axis at control session, (B) pitch axis at robot-assisted session, and (C) yaw/roll behavior 
representation at control session. Cervical posture at (D) pitch axis at control session, 
(E) pitch axis at robot-assisted session, (F) yaw/roll axes at robot-assisted session, 
(G) heart rate mean during control and robot-assisted session, and (H) BS mean results 


during control and robot-assisted session. 
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5 Discussion 


CVDs are considered the main cause of death worldwide, taking the 
lives of 17.9 million people each year. Similarly, neurological diseases are the 
major cause of disability in the world, with an increasing rate projected to 
reach over 100 million people with disability by 2030. Taking into account 
the context of this problematic, this chapter presented recent advancements 
in the field of SARs, where an SAR was incorporated in cardiac and NR 
therapies to act as a companion and assistant during the sessions. With the 
realization of this work, it was expected to increase patients’ commitment 
to the therapy, aiming to improve their performance, and therefore ensure 
a greater recovery and quality of life. 

Throughout the development of this chapter, the potential benefit that 
social robotic platforms exhibit in rehabilitation and physical training was 
discussed. Similarly, a proposed robot-based therapy model suitable for 
cardiac and NR was described and deployed in both scenarios. In the first 
place, a custom cHRI was developed for each application, followed by 
the experimental study that took place in real clinical contexts to assess 
the influence of the cHRI within the therapies. Regarding the results pres- 
ented in the previous section, there are significant findings related to the 
therapy performance. 

In both scenarios, one major feature that elicited positive outcomes was 
the continuous monitoring. In the cardiac therapy it was possible to detect 
and control potential risk factor events (e.g., increased HR or extremely 
high intensity of the exercise perceived through the BS). Likewise, for 
the NR, the continuous monitoring allowed the system to support the 
therapist’s activities and reduce their workload. Hence, the therapist can 
focus on a more specific task while the robot can focus on monitoring 
general variables, such as the HR and posture parameters. 

Based on the continuous monitoring, it was also possible to perform 
posture corrections in both scenarios. For the cardiac therapy, the robot 
is capable of performing appropriate posture corrections. In this context, 
the correction is carried out to reduce the risk of falling from the treadmill 
or experiencing dizziness that makes the exercise more difficult. As stated in 
the results of the study, the robot was able to perform more than 50 correc- 
tions. This result reflects the advantage of having such a system, since it can 
support the tasks of the clinical staff, and, more importantly, it can deliver 
safe therapy. On the other hand, for the NR, the posture correction was 
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focused on complementing the task of the therapist. As the physical robotic 
platform Lokomat has partial control of the body (i.e., it controls the lower 
limbs unlike the upper limbs), the social robot seeks to monitor this part of 
the body and encourages the patient to adopt an appropriate posture while 
the therapist focuses on the correct execution of the exercises. As described 
in the results of the study, evidence was found that the patient adopts a 
correct posture more regularly in the presence of the robot. This result 
indicates the effectiveness of the robot-based therapy. 

Finally, one aspect that is worth mentioning is the safety and motivation 
that this kind of system can deliver in this context. Throughout the studies 
that were carried out in both applications, we evidenced that the SAR can 
elicit a perception of safety by the patient during the therapy. Thus, this 
safety generates more confidence in the patient to perform the exercise and 
therefore their motivation increases. This effect holds a promising potential 
in terms of enhancing the physical performance exhibited by the patients. 





6 Conclusions 


In this chapter, the design and implementation of cHRI systems were 
presented. Two experimental studies were performed according to the 
needs of the cardiac and NR context. Each system has an individual sensory 
architecture that allows the use of a robot-based therapy model to improve 
the conventional rehabilitation and the patient’s performance. Both systems 
allowed relevant patient data acquisition, processing, and an online feedback 
using SARs. 

Important results showed that robot assistance during the therapy has a 
positive impact, which is reflected in the decreasing of risk factors such as 
high HR values or fatigue perception and the improvement of patients’ per- 
formance indicators such as cervical and thoracic postures. As initial obser- 
vations, in both cases, we found a positive attitude toward the robot role and 
patients exhibited a greater motivation to follow the rehabilitation treatment 
and improve their own performance according to the robot’s requests and 
corrections. 

Moreover, due to the monitoring capabilities of the cHRI system and 
the robot interaction, therapists were more focused on providing feedback 
to the patient about other parameters that are crucial in rehabilitation, or 
performed alternative tasks (e.g., assessed more patients and controlled the 
features of Lokomat), while the robot provided feedback and corrections. 
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This companionship is important, since the assessment and progress of the 
patients’ performance can improve thanks to the accuracy of the monitoring 
and a thorough surveillance of the therapy. 

Although the results presented in this chapter are promising, this research 
is still in an early stage. Thus, the findings of this work will serve as the basis 
to extend our studies to a larger scale. Therefore, as a further step we propose 
to test our CHRI systems in a long-term study, following a greater number of 
patients and sessions. This will allow a more robust statistical analysis, pro- 
viding meaningful information associated with the adherence, motivation, 
and health evolution within the therapies. Moreover, regarding the HRI, 
it is expected to enhance the robot’s behaviors, aiming to provide a more 
personalized interaction. This goal will be achieved by incorporating 
memory on the robot and additional robot features to achieve long-term 
interaction. Hence, the robot will be able to recognize each patient, their 
performance, and progress throughout the complete program. 
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1 Introduction 


Steerable needles are used in different minimally invasive procedures 
such as brachytherapy, biopsy, and neurosurgery. In these methods, hollow 
long flexible bevel-tipped needles are inserted into the human body for diag- 
nosis, treatment, or sample removal. During these procedures, the targeted 
organs and the needles are monitored using different imaging methods such 
as ultrasound (US), fluoroscopy, and X-ray. Accurate needle positioning 
minimizes the undesirable side effects on the healthy and neighboring tissue 
and is a crucial factor in determining the efficiency of these methods. The 
desired needle path depends on the application. In biopsy, it is desired to 
reach a constant final deflection, whereas in brachytherapy the needle should 
follow a straight path. In case of having obstacles on the needle path (such as 
bones or nerves), the needle should follow a preplanned curved. In general, 
needle deflection, tissue deformation, and limitations in controlling the 
needle from outside the body are the challenges in accurate needle tip posi- 
tioning, which are discussed in Section 2. 

Section 3 is devoted to robot-assisted surgical systems for beating-heart 
surgery. Cardiovascular disease is one of the leading causes of death world- 
wide. Conventional extra-and intracardiac surgeries need the heart to 
be arrested by connecting the patient to a cardiopulmonary bypass (CPB) 
machine (Ruszkowski et al., 2015). However, arrested-heart surgery has 
adverse effects due to using CPB (Dacey et al., 2005; Newman et al., 
2001; Paparella et al., 2002; Zeitlhofer et al., 1993; Bellinger et al., 1999). Dif- 
ferent from arrested-heart surgery, beating-heart surgery could eliminate such 
negative effects of CPB by allowing the heart to beat normally (Angelini et al., 
2002), and could also enable intraoperative evaluation of the heart tissue 
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motion, which is critical to the assessment of reconstructive heart operations 
such as mitral valve surgery (Fix et al., 1993). The most prominent challenge 
to be addressed for beating-heart surgery is the rapid motions of the heart 
whose movement velocity and acceleration are approximately 210 mm/s 
and 3800 mm/s», respectively (Kettler et al., 2007). Manual tool position 
compensation according to the heart motion will not only lead to the human 
operator’s fatigue and exhaustion but risks tool-tissue collision and tissue 
injury. The application of robot-assisted surgical systems and control methods 
for synchronizing the surgical robot’s motion with the beating heart’s motion 
are discussed in Section 3. 





2 Needle insertion procedures 


Prostate cancer is the second frequent cancer in men around the 
world, with an estimation of 1.1 million new cases to have occurred in 
2012 (Torre et al., 2015). One leading treatment option for early-stage pros- 
tate cancer is US-guided brachytherapy, which is a type of radiotherapy. In 
this method, radioactive seeds are implanted around the prostate gland to 
deliver the radiations internally. The margins of the prostate and the target 
volume are found using preoperative axial images and are further used for 
preplanning the seed locations and the dosage distribution. The seed implan- 
tation is accompanied by intraoperative transrectal ultrasound (TRUS) 
images to provide visual information for needle guidance. These images, 
as well as the desired seed locations, are registered with respect to a 
5-mm grid template. Several needles loaded with radioactive seeds are 
inserted through the template, and it is desired to insert the needle on a 
straight path to the final depth. The seeds are implanted on the needle track 
by retracting the needles and pushing out the seeds using a stylet. In brachy- 
therapy, the preplanned location of the seeds is a determinant factor in defin- 
ing radiation dosage and therefore is of great importance. Errors in the seed 
positioning reduce the method efficiency as instead of cancerous tissue, 
healthy tissue is imposed to the radiations. 

Using a grid template, the desired path to the final depth is a straight line. 
However, this can only be true if there are no sensitive tissue such as nerves, 
blood vessels, or bones are on the needle path. In the case of pubic arch inter- 
ference, which is common in patients with large prostate (Wallner et al., 
1999), the needle path to the anterior prostate is obstructed. In such case, 
the needle should be steered on a desired curved path to go around the obsta- 
cle and reach the final depth. This scenario is in demand of finding feasible and 
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collision-free trajectories from the insertion point to the final point and 
steering the needle on the desired path. Steering the needle on the desired path 
can be done using axial needle rotations to change the bevel orientation, 
insertion velocity, needle base lateral position, and needle base force/torque. 

In manual insertions performed by experienced practitioners, the abso- 





lute seed positioning error is about + 5 mm (Taschereau et al., 2000). To 
improve the seed positioning, intelligent assistant robots can be used to steer 
the needle toward the target and compensate for the errors caused by the 
needle and tissue deformation. In robot-assisted procedures, for safety rea- 
sons, it is desired to split the tasks between the clinician and the robotic sys- 
tem to keep the clinician in the loop. For example, the robotic system only 
controls the needle rotations, whereas the surgeon selects the initial insertion 
point and performs the insertion. 


2.1 Related work 


Depending on the application, different scenarios are possible in needle 
insertion procedures. For all situations, the first step is to plan the desired 
trajectory. The path planner should consider the insertion and target points, 
the location of the obstacles, and the constraints on the needle motion. 
Similar to path planners, motion planners provide not only a feasible path but 
also the control inputs required for following the path (Minhas et al., 2007; 
Schulman et al., 2014; Wang et al., 2014; Moreira et al., 2014a; Majewicz 
et al., 2014). However, in order to compensate for the errors caused by tissue 
nonhomogeneity and modeling uncertainties, replanning is necessary, 
which requires the motion planners to be computationally fast (Duan 
et al., 2014). 

Another way to deal with the steering problems is to use feedback con- 
trol strategies (Abolhassani et al., 2007; Haddadi et al., 2010; Abayazid et al., 
2013; Rucker et al., 2013; Khadem et al., 2016; Sovizi et al., 2016; Fallahi 
et al., 2016b, 2017, 2018). This approach is based on the closed-loop feed- 
back structure to calculate the control inputs. In motion planning, the 
steering commands are calculated for the current and future times, however, 
in feedback control methods, the commands are found only for the present 
time. By taking the desired path (found by any path planner), the controller 
is responsible for calculating the control commands to compensate the 
errors. The planner/controller should be provided with information about 
needle forces, needle shape, and tip pose (position and/or orientation) in real 
time. However, due to the nature of the procedures, in many situations, 
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some of these variables cannot be measured directly. As the needle is inserted 
into the tissue, the needle is tracked using imaging modalities. The images 
are combined with image processing techniques to translate visual informa- 
tion into numerical values to be used by the computers. US imaging is a cost 
effective and widely used imaging modality, which can be used to track the 
needle and find the needle tip position. There have been different methods 
proposed in the literature for image registration and needle position and 
shape estimation using US images (Uher¢ik et al., 2009; Asadian et al., 
2011; Zhao et al., 2012, 2013; Malekian et al., 2013; Kaya and Bebek, 
2014; Waine et al., 2016; Rossa et al., 2016). 

However, using the US images, it is not possible to measure the needle 
tip orientation as the low-resolution images, and the small diameter of the 
needle does not provide sufficient information for detecting the needle tip 
heading. Moreover, due to the limitations on the sensor dimensions and the 
sterilization issues, using needle-mounted pose or force sensors in clinical 
applications is not practical. This limitation is the motivation to employ 
observation methods and estimate the nonmeasurable variables using the 
mathematical models and the measured variables. In the sequel, we first 
provide an overview of needle steering modeling and then focus on different 
methodologies proposed for state observation, planning, and control in 
needle steering. 


2.2 Modeling 


The design and programming of needle steering systems require a suitable 
model that represents the system’s behavior and describes the relation 
between the system inputs and outputs. There have been different modeling 
approaches proposed in the literature such as finite element methods 
(DiMaio and Salcudean, 2003, 2005; Goksel et al., 2006; Dehghan and 
Salcudean, 2009), flexible beam theory (Yan et al., 2006, 2009; 
Chentanez et al., 2009), energy-based methods (Misra et al., 2010), and 
the kinematic model (Webster et al., 2006). The kinematic model proposed 
by Webster et al. (2006) is anonholonomic model. In this model, the needle 
is assumed to move on a curved path with constant curvature (circle). As the 
needle path curvature depends on the needle and tissue properties, for each 
needle/tissue combination, the needle path curvature should be found using 
curve-fitting methods. The main advantage of this model is its simplicity. It 
provides an intuitive and computationally efficient method for predicting 
needle deflection, which makes it suitable for planning and control purposes. 
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In this model, the motion of the needle resembles the motion of a unicycle 
and its kinematics are found as Webster et al. (2006) 


y(t) = gav(t)(vV1 + ua) (1) 


e 03 
al al ° 


where the operator (7°) is defined as 


with 


WM, 0 —W3 W2 
“:laolre| 0 —@| (3) 
M3 —W2 (nT 0 


In Eq. (1), gab = i a is the rigid transformation between frames {A} 
and {B}, as shown in Fig. 1. The vector P,, = [x y Z|" and the matrix R,y 
represent the position and the orientation of the moving frame {B} with 
respect to the fixed frame {A}, respectively. v and u are the insertion velocity 
and the needle axial rotational velocity, respectively, and ei = 1, 2, 3) rep- 
resent the standard basis vectors in R®. x is the needle path curvature, which 
due to the tissue nonhomogeneity encounters uncertainty. This value, 
however, is considered to be bounded, and its bounds can be determined 
preoperatively and be written ask <K<K. 







Needle anlage 
otation 
f° 
las = 
107 {B} Ny 


Obstacle 


Fig. 1 The needle in 3D space, desired path and obstacle. Frame {A} is the fixed frame 
and frame {B} attached to the needle tip is the moving frame. v and u are the insertion 
and rotation velocity, respectively. 
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The coordinates free representation (1) can be expanded to 


0 
p=RI{0 (4a) 
v 
0 —-u 0 
R=R|u 0 —xv (4b) 
O Kv 0 


Defining the vector q=[x, y, 2, a B, y]" 
nates, which is well defined on 


as the generalized coordi- 


U={qER°:a,y ER, f € [-2/2,2/2]} (5) 


Kallem and Cowan (2009) have presented the Z-Y-X representation of the 
needle kinematics (1) as 


x=vsinp (6a) 
y=—vcosfsina (6b) 
Z=vcosacosp (6c) 

a =xkvcosysecP (6d) 

B =kvsiny (6e) 

y¥ =—kvcosytanf + u (6f) 


The values a, f, and y are the yaw, pitch, and roll angles, respectively, and 
represent the orientation of the origin of the moving frame { B} with respect 
to the fixed frame {A}. The relation between the rotation matrix R and the 
three angles is given by premultiplying the three basic rotations about the 
axes of the fixed frames (Taghirad, 2013). In reality, due to the presence 
of the tissue and the limited curvature of the needles, the angles a and f 
remain bounded, and more bending is related to larger values of these angles. 
The upper bound on these angles, which depend on the desired path trav- 
eled by the needle, can be determined in the planning level. Therefore, it is 
assumed that |a| < a®* and |p| < p* with a*, P*E [0, 2/2]. 
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In Eq. (6), by setting # = 0 degrees and y = 0, 180 degrees, the two- 
dimensional (2D) needle motion can be found as 


Z cosa 
y| =| sina }v (7) 
a ck 





The earlier equation represents the planar deflection of the needle in Y-Z 





plane. In this case, the + sign determines the two possibilities for the 
bevel orientation as well as the concavity of the needle path curve in the 
plane as shown in Fig. 2. This model is later extended to account for paths 
with variable curvature by using an omnidirectional wheel (Fallahi 
et al., 2015). 


2.3 Measurement and observation 


In manual needle insertion procedures, the surgeon tracks the needle visually 
using imaging modalities. US imaging is a fast, widely used, and cost- 
effective method, which compared to other modalities such as magnetic res- 
onance imaging and computed tomography, provides real-time tracking of 
the needle during the procedure. This visual information can be translated 
into numerical values using image processing techniques and be used in 
feedback computations. Different methods have been proposed in the liter- 
ature for needle localization, that is, estimating the needle position in US 
images. Rossa et al. (2016) proposed a method for predicting the needle 
tip position using the deflection of a single point along the needle. Random 
sample consensus (RANSAC) is a robust method to fit polynomials on the 
curves in the three-dimensional (3D) space (Uhercik et al., 2009). This iter- 
ative method employs a set of observed data and deals with outliers to find 
the model parameters. Combining this method with Kalman filters reduces 
the search area and speeds up the algorithm (Zhao et al., 2012, 2013). Waine 


Bevel down Bevel up 





Fig. 2 Two possible orientations of the bevel in planar motion. 
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et al. (2016) have employed the RANSAC algorithm to find the needle tip 
position using 2D US images. Malekian et al. (2013) combine the RANSAC 
algorithm with a denoising method to increase the accuracy. Asadian et al. 
(2011) estimated the needle tip velocity from a noisy position using a 
high-gain observer. 

In these methods, the needle tip position is acquired from the US images 
and the word “estimation” is used. However, since using needle-mounted 
sensors is not clinically feasible, the US images are the only source of position 
measurements, and therefore, the estimated values should be accepted as the 
true position “measurement.” 

Besides, according to Eq. (6), acquiring information about the needle tip 
heading is advantageous in controlling the needle tip position. However, it is 
not possible to measure the orientation parameters using US images, since 
due to the small diameter of the needle and the low resolution of the images, 
the bevel orientation is not detectable. Measuring the orientation requires 
utilizing sensors such as needle-mounted electromagnetic tracking sensor, 
which suffers from sterilization issues. The controller designed in Rucker 
et al. (2013) requires all the orientation parameters. This controller is 
implemented using a five-DOF magnetic tracking sensor and combined 
with a Kalman filter. However, since suitable sensors are not accessible, state 
observers can be employed to estimate the needle tip orientation. The state 
observers are computer-implemented systems, which run concurrently to 
the real system. The observer equations are formed using the system equa- 
tions and additional corrective terms. If the observer is convergent, its states 
provide an estimate of the system’s nonmeasurable state. Kallem and Cowan 
(2009) use the 3D kinematic equations (6) and design a linear observer/con- 
troller. Later, this observer is used in many other works. Reed et al. (2008) 
employed the linear observer to estimate the needle tip orientation and used 
the estimated variables in a low-level controller, which works along with a 
high-level 2D planner to steer the needle on the optimal path. In 
Motaharifar et al. (2015), the same transformation is used, and a nonlinear 
observer is designed to be used with an adaptive controller. In Kallem 
et al. (2011), this linear observer is designed for the reduced configuration 
space and is fed to the fiber space observer to estimate the full system states 
for a planar task. In Swensen et al. (2014), a model for torsional dynamics of 
the needle is presented and augmented with planar variables. The system is 
then linearized, and a Kalman filter is employed to estimate the system states 
and apply a state feedback control. Using Eq. (6) and the nonlinear 
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; _4T ; 
transformation s= [ x vsinB —Kv* cosB siny | , the system equations can 
be written as 


s=As+ Bh (8a) 
y=Cs (8b) 
with 
010 0 
A=|001], B=|lo|, C=[1 0 0], d=" — a) 
0 0 0 1 
where v'= x’ sinf — Kv"(cosBcosy)u is defined as the new control variable 


and the observer is formulated as § = As + Bf + L(y— 7). In this equation, 
(7) denotes the estimated values and L is the observer gain to be designed 
such that A + LC is Hurwitz. Using the linear observer, an observer-based 
linear controller is designed in Kallem and Cowan (2009), which due to the 
singularities in the nonlinear system, can only be applied to stabilize the nee- 
dle in one plane. In Fallahi et al. (2016a), the same transformation is used, 
however, instead of linearizing the whole system, the term @ is selected as 


b= —(kv)? 9 £Kvuv/1 — (2 +32) (10) 





and its effect is considered by rewriting the observer equations as 
§= ASt+ b + AgL(f— y) with Ag = diag{0, 0°, 0} and @ > 1. The problem 
with the nonlinear observer in this form is that @ does not satisfy the 
Lipschitz continuity condition, and the convergence of the observer is 
guaranteed for certain assumptions to keep the states bounded. Due to 
the small number of researches performed for estimating the needle tip ori- 
entation, this subject remains open for further studies. 


2.4 Planning 


The nonholonomic constraints on the needle kinematics confine the needle 
moves to a set of reachable points and limit the trajectories that can be 
followed by the needle. Considering the location of the obstacles and the 
constraints on the needle, the path planner is responsible for finding a fea- 
sible, collision-free path from the insertion point to the target. Depending 
on the planning method used, other criteria such as parameter uncertainty, 
noise, and optimizations can be taken into account. A motion planner, 
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however, not only plans the desired trajectory but also finds a sequence of 
commands for steering the needle on the planned trajectory. In other words, 
motion planning is a combination of path planning and an implementation 
method. In the ideal situation, these commands should steer the needle on 
the desired trajectory. However, in reality, due to the modeling and para- 
metric uncertainties, noise, and tissue nonhomogeneity, the needle position 
deviates from the desired trajectory. In Schulman et al. (2014), the errors are 
compensated by insertion, partial retraction, rotation, and further insertion 
of the needle. However, retractions and reinsertions are not desirable as they 
increase the tissue trauma. Another solution for dealing with uncertainties 1s 
to perform replanning to compensate for the errors caused by tissue non- 
homogeneity. Wang et al. (2014) propose the planner for dynamic environ- 
ments using a mass-spring model for the deformable tissue. The dynamic 
planner is equipped with a vision system to track the radius of curvature, 
which is used in replanning and updating the path to adapt to the changes 
in the position and curvature. Such performance, however, requires the 
planner to be fast enough. Duan et al. (2014) show by experiments that 
the computations are done in 1.6s which enables replanning for error 
compensation. 

The desired path can be either a constant-curvature path or a variable- 
curvature path. A constant-curvature path is composed of a sequence of cir- 
cular segments. Considering the axial needle rotations as the main control 
input, proper changes in the needle tip orientation at each segment steers 
the needle on the desired path. This can be done by the stop-turn strategy. 
In this strategy, the insertion and rotation commands are separated, meaning 
that for each segment, the needle is purely inserted to a certain depth and is 
stopped to perform the rotation, and the rotated frame is propagated by fur- 
ther insertion (Duindam et al., 2008). In this case, the output of the motion 
planner is the depth and the magnitude of rotation. 

A variable-curvature path is a curved path with different curvatures 
along it. The strategy for steering the needle on such path is based on 
duty-cycle spinning. Minhas et al. (2007) showed that by duty-cycle spin- 
ning of the needle, paths with different curvatures can be achieved. In this 
method, the duty cycle, which determines the ratio between the simulta- 
neous insertion and rotation time to the pure insertion time, is found as a 
function of the desired curvature. This method, however, requires the max- 
imum value of the needle path curvature, which due to tissue inhomogene- 
ity might be variable. Moreira et al. (2014a) have integrated online curvature 
estimation to 3D planners and duty-cycle spinning to overcome the 
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curvature uncertainties. Majewicz et al. (2014) present two strategies for 
duty-cycle spinning to overcome the hardware limitations such as cable 
windup. 

There have been different techniques used in the literature for motion 
planning of the needles such as optimization-based methods, rapidly explor- 
ing random tree (RRT) algorithms, and inverse kinematics. In 
optimization-based methods, efforts are made to optimize a predefined cost 
function subject to obstacle and needle constraints. One main criterion in 
clinical procedures is to minimize the trauma imposed on the tissue and 
to avoid collisions with any sensitive tissues. To this end, the planning 
method can be formulated as an optimization problem subject to equalities 
and inequalities constraints. Different optimization methods are used to find 
the optimal path in the sense of path length, the number of rotations, and 
distance to the obstacles (Bobrenkov et al., 2014; Wang et al., 2014; 
Schulman et al., 2014). 

The RRT algorithms use the fast exploring methods to find all the fea- 
sible points. The RRT algorithm is a randomized path planning method 
proposed specifically for nonholonomic systems. This method is based on 
searching the state space, excluding the states that lie in the obstacle regions. 
Due to the nonholonomic constraints and the maximum curvature of the 
needle, the reachable region of the needle is a mushroom-like area 
(Vrooyink et al., 2014), so not all the configurations are reachable from 
the current configuration. To overcome this limitation, different modifica- 
tions have been made on the RRT algorithm and used for needle path plan- 
ning (Vrooijink et al., 2014; Bernardes et al., 2011, 2013, 2014; Shkolnik 
et al., 2009; Patil and Alterovitz, 2010). 

The inverse kinematics of the robotics manipulators determine the rela- 
tion between the Cartesian space variables and the joint space (Craig, 2005). 
Similarly, for a bevel-tipped needle the inverse kinematics can be defined as 
the relation between the needle tip pose, that is, position and orientation, 
and the translation and orientation at the needle base. This method is usually 
employed along with other methods such as numerical calculations, space 
discretization, geometric methods, and optimizations (Duindam et al., 
2010; Glozman and Shoham, 2004). 


2.5 Control 


There are two main differences between the needle steering control and 
motion planning. In control, the steering is performed in a closed-loop 
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Fig. 3 Control loop for needle steering. 


feedback structure. In this method, the controller calculates the control sig- 
nal in real time based on the error, which is provided to the controller in the 
form of feedback, as shown in Fig. 3. However, unlike the motion planners 
that produce a sequence of control inputs for the current and future times, 
the controller only outputs the control action for the current time. More- 
over, in planning methods, the errors caused by uncertainties and tissue non- 
homogeneity are compensated by replanning the desired path and the 
control sequence. In control, the desired input to the feedback loop is 
designed using any off-line path planner, whereas the controller is respon- 
sible for correcting the errors and steering the needle on the desired 
trajectory. 

Due to the nonlinearity of the needle kinematics and dynamics, different 
control strategies such as model-based methods, probabilistic methods, and 
robust strategies have been applied to needle steering control. From a con- 
trol perspective, in Haddadi et al. (2010), the controllability of the needle in 
soft tissue is studied using a dynamic model. Abolhassani et al. (2007) pro- 
pose a method to perform the axial rotations when the needle deflection 
reaches some predefined threshold. In this method, the force data and the 
needle’s model (flexible beam model) are employed to calculate the deflec- 
tion and the rotation locations, and the goal is to keep the needle moving as 
straight as possible. Using a mechanics-based model of the needle, Khadem 
et al. (2016) developed a nonlinear model predictive controller for 2D nee- 
dle steering, which is based on iterative optimization of the predictions. In 
Abayazid et al. (2013), fiber Bragg grating sensors are used to reconstruct the 
shape of the needle, which is used as feedback in the steering algorithm. The 
algorithm uses geometric methods to find the reachable regions and steers 
the needle such that the target lies in these regions. Considering the prob- 
abilistic approaches, Sovizi et al. (2016) propose a planner for 2D environ- 
ment with obstacles using linear programming (LP). In this method, the 
uncertain system is approximated by a chain of discrete Markov process, 
considering the stochastic tissue motion. The optimal solution to this LP 
problem is found by minimizing the expectation of the cost function. 
Van Den Berg et al. model the needle motion and the sensor noise as a 
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stochastic process and use linear quadratic Gaussian optimization to obtain a 
minimal probability of intersection with obstacles. Due to the nonlinearity 
of the equations, this method linearizes the model around the path and con- 
trols the deviation from the that. In this work, different paths are found, from 
which the optimal one that minimizes the probability of intersections with 
obstacles is selected. The path is then implemented by duty-cycle spinning. 
Approximating the probability density function of the needle as a Gaussian 
variable, Park et al. (2010) use a path planning-based method for steering 
through intermediate steps using the path of probability algorithm. At each 
step, the position of the needle is compared to the desired intermediate step 
and the next step is determined to maximize the probability that next points 
reach the target. 


2.5.1 Sliding mode control in needle steering 
Sliding mode control (SMC) is a technique, suitable for systems with distur- 
bances and uncertainties. This method provides a robust approach for 
reaching the desired performance (Dodds et al., 2015). This is a discontin- 
uous method, in which the control input switches between two limits. If the 
system under control is of degree n, the SMC redefines the problem as sta- 
bilizing a differential equation SHOW cay” iva) of order n — 1, 
which is a relation between the system output and its derivatives. Here, h 
is the function relating the system states to the output y and yy is the desired 
output value. The desired performance of the closed-loop dynamics is 
expressed as S = 0, which happens by proper design of the controller. The 
method proposed in Rucker et al. (2013) is a sliding-based method, where 
the measurements from a five-DOF magnetic tracking sensor are combined 
with a Kalman filter to estimate the full needle tip orientation. This infor- 
mation is then used to express the Cartesian position error in the needle tip 
frame. Based on the error, the sliding mode controller constantly rotates 
the needle and moves it on a helical path to reach the desired target. In the 
sequel, sliding-based methods are presented, which only require the needle 
tip position measurement. 

For the system equations (4), the sliding functions along x- and y-axes, 
S;, (i = x,y), can be defined as 


S;= be; + ce; (i=x,y) (11) 


in which e, = x — xy and e, = y — yy. In this function, b and c are constant 
coefficients, which determine the convergence rate of the error and x, and y4 
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are the desired position along the x- and y-axes, respectively. If xy and yg are 
constant, their first and second time derivatives equal zero, which simplifies 
the time derivative of Eq. (11) as S,. = bx + cx and Sy = by + cy. Consider the 
Lyapunov function V;=4S;(i=~x,y). The goal is to find the control input 


such that V = S;S; < —n|S;|, which leads to S;, or equivalently, the error 


along the desired axes approach zero. 


2.5.2 2D switching control 

Consider the planar control of the needle, using the Y-Z deflection equa- 
tion (7) and the two possible inputs for the bevel orientation. It is required 
to have 


S,>n if S,<0 
: 12 
ee if S, > 0 (12) 


Using the assumption in Section 2.2, stating that |a] < a* with 0 < a* 
< 2/4, the sign of the first term in S y only depends on the bevel orientation. 
If b and c are selected such that 


b 
nT (13) 
C. 


then by selecting + k when S, < 0, and — k when S, > 0, Eq. (12) is satisfied. 
This means that every time S, changes sign, the needle should rotate to 
change the bevel orientation. As a result, when S, is close to zero, chattering 
may happen, which increases tissue trauma. To prevent such behavior, the 
switching can be performed using the switching threshold S, as shown in 
Table 1. A smaller switching threshold is beneficial in having smaller errors; 
however, it increases the number of rotations. Details about selecting the 
switching threshold can be found in Fallahi et al. (2016b). 


Table 1 Selection of the operating mode based on Sy. 





Region System mode sign(Sy) 
S,< —S, Mode 1 (k > 0) + 
—S,.<S,< S, No mode change + or — 


S, > S, Mode 2 (xk < 0) - 
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2.5.3 Three-dimensional sliding mode control 

In order to extend the 2D method presented in the previous section to 3D 
environment, two sliding functions are considered and combined for com- 
pensating the error in the 3D space. The sliding functions S, and S, are 
defined using Eq. (11) for constant values of xg and yy with c= 1. Taking 
the time derivative of the sliding functions and substituting from Eq. (6) 
gives 


S.=b,.Kv’ cosBsiny + vsinB (14) 

Ss, = —byKv* cosacosy — by Kv? sinPsinasiny + vcosfPsina (15) 
Considering the x-direction, there are two terms on the right-hand side of 
Eq. (14). Ifthe absolute value of the first term is greater than the second term, 


that is, |b.«v* cosPsiny| > vsinf, the first term determines the sign of S. 
According to Eq. (5), since cos > 0, using x > 0 and v > 0, this condition 





can be written as 
. 1 
| siny| >——|tanf| (16) 
b.KV 
Similarly, for the y-axis, if 


1 
|cosy| > |sin#tanasiny| + ha cosP tana (17) 
ykv 


the term —sgn(cosy) determines the sign of S,. Similar to the 2D case, 
according to sgn(siny) and sgn(cosy), there are two possibilities for each 
direction, leading to the total number of four possibilities (four quadrants) 
for the 3D case, as shown in Fig. 4. For example, if S, > 0 and S) <0 require 
S.<Oand ce > 0, which is equivalent to siny < 0 and cosy < 0, or having y 
in the third quadrant. This can be written as 


Vd = atan2(—S,, S)) (18) 


In this equation, v4 € [—Z, a] is the desired roll angle and the function atan2 
represents the tangent inverse function considering the sign of the two 
inputs to return the appropriate quadrant of the calculated angle. However, 
this is only true if Eqs. (16), (17) are satisfied. To ensure this, the parameters 
can be selected for the worst-case scenario. Using the assumption |a| < a* 
and |p| < P*, Eqs. (16), (17) can be combined as 
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Fig. 4 The corresponding quadrant for yg based on sgn(S,) and sgn(S,). 


1 
arcsin (+ unp*) <|y4| 
by Kv 


x 


(19) 


< arccos (sing tana* + oi cos f* una) 
byKv 
in which a and f are substituted by a* and *, respectively. This inequality 
gives the criteria for selecting the design parameters b,. and by. According to 
the definition of S; (i= x, y), smaller values of b; are more desirable for having 
faster convergence; however, this will force a* and /* to be small, limiting 
the reachable workspace. From Eq. (19), it is clear that b,, b,, a*, and 6* all 
affect the acceptable value of yz. The control input can be found by control- 
ling the angle y to the desired value yq in Eq. (18). 

Note that since the needle system does not have any equilibrium 
points, the controller can only keep the sliding function very close to zero, 
because as long as the needle is moving the time derivative of the states 
changes. One way to deal with this property is to focus just on the deflection 
error and not on its time derivatives. This can be done by using a rotating 
sliding function, as shown in Fig. 5. The sliding surface (11) defines a line 
in the phase plane and can be rotated about the origin by changing the slope 
of the line au =x, y). In Fig. 5, as the sliding function is rotated toward the 
vertical axis, the error decreases. The sliding function with variable slope is 
written as 


§;= bi + ei(bi +1), i=x,y (20) 
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Fixed sliding 
function 


Fig. 5 Phase plane representation of the fixed and rotating sliding functions. 


Selecting b; = —1 gives 


S, = b,KvcosPsiny (21) 


5. = —b,kvcosacosy + b)kvsinfsinasiny (22) 


Since b; (i= x, y) should be positive, the initial condition b,(0) is selected such 
that b;(0) > = where D is the final insertion depth and v is the insertion 
velocity. This structure relaxes the constraint (19) as 


1 


t ae 
jean ya sin B* tana* 


(23) 
in which there is no dependence on the needle path curvature x. Using 
the rotating sliding function, b; gets smaller with time, which increases 
the weight of the position error in the sliding function, leading to smaller 
errors. The stability proof of this method and more details are provided 
in Fallahi et al. (2017). 


2.5.4 PWM switching and sliding mode control 

The application of the sliding mode technique for needle steering is not lim- 
ited to the methods mentioned earlier. In the following, the application of 
SMC in an averaged model of the needle steering system is presented. The 
average-based structure models the 3D needle steering system as a four- 
mode switching system to transform the continuous input into a switching 
sequence. In this structure, the 3D system is divided into two 2-mode 
switching subsystems. Assuming the switching is performed in a pulse width 
modulation (PWM) structure, the time averaged of each subsystem across 
the PWM period represents the original subsystem. For each subsystem, a 
virtual input is defined, which can be designed individually and gives the 
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duty cycle of switching for the subsystem. The duty cycles from both 
subsystems are then combined to steer the needle in the 3D space. Here, 
the sliding mode technique is used for designing the controllers for each 
subsystem, which shows another application of sliding mode technique in 
the context of needle steering. 

The time-averaged model is given by Fallahi et al. (2018) 








er Acer a a ee (24a) 
a= 4y(f, + byltiy|) + (1 — dy) Fp — bylity|) =f + byuy (24b) 

with 
Uy = (2d, — 1) |d,| (25a) 
y= (2d, — 1) |, (25b) 
where b,=xKv* cos, f,=Kv*sinasinfsiny,, b,=—Kv* cosa, ty = sinyg, 


and ut, = cosy, . The angle y, is the desired roll angle, which for each direc- 
tion, can take only two fixed values (modes) separated by 180 degrees, such 
that vq € [0, 2] for the x-axis and yg € [—a/2, 2/2] for the y-axis. The pre- 
vious equations are found with the assumption that the switching bet- 
ween these two modes is performed according to the normalized PWM 
period D; = [d; 1 — dj] with ||D| = 1 (i = x, y). Here, u, and u, are the 
virtual inputs for the subsystems, which should be designed properly. 





Regardless of the method used in designing these control signals, these 
values can be converted into the duty cycles d,. and d, to determine the duty 
cycle of switching between the two modes as 

je i=x,y (26) 

2 

Since a, and uy are related to siny, and cosy,, respectively, it is possible to 
integrate the two 2-mode subsystems to build up a four-mode composite 
system. These four modes are selected based on the sign of siny, and 
cosyq, as shown in Fig. 6A. Through this selection, if |tany,|=1, equal 
weights are given over the x- and y-directions. This weighting can be chan- 
ged by selecting |tany,| > 1 or |tany,| <1. The switching pattern is shown 
in Fig. 6B. 

In this formulation, u, and u, can be designed using different control 
strategies and then transformed into the duty-cycle variables d,. and d, to 
be used in the 3D switching framework. In the sequel, the sliding mode 
technique is used for designing the control signals u,. and u,, which provides 
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Normalized PWM period + —____> 
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cos ya > 0 cos Ya < 0 














cos ; 
sinya > 0 sin ya <0 
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sinya <0} siny <0 ® 4) @ 
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cos "Ya > 0 COS Ya £0 
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Fig. 6 The four-mode switching pattern. (A) The half plane modes for each subsystem 
and the resultant four modes: @sinyy>0,cosyg>0, @sinyg>0,cosyg <0, 
@sinyg <0, cosy, <0, @sinyy <0, cosyg >0. (B) The switching pattern when d, > 
dy and dy > d,. 

















a suitable solution to deal with parameter uncertainties and disturbances. 
Moreover, due to the lack of proper measurements of the angles a and # 
their uncertainties should be considered in the equations. The terms depen- 
dent on these angles appear as bounded trigonometric functions, for which 
their bounds can be used to define the nominal and uncertain systems. Using 
the bounds on the needle curvature and the orientation-related terms, the 
bounds on b, and b, can be written as 


Kv cosB* < by < Kv" (27a) 


Kv cosa*® < bs Kv" (27b) 


Assuming kK, b,, and b, as the nominal values of the parameters defined by the 
geometric mean of the previous bounds as K = \/KK, by = kv \/ cosf*, and 
by= —kv*V cosa*, the nominal subsystems can be written as 


Xq = byiiy (28) 
with 


(Ege *) _ é < ea -) _ (29) 
K —~ by K 


Similarly, the nominal subsystem in the y-direction can be written as 


Ya =. oF byiiy (30) 
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with 





<2Kv" (31a) 


12 4 = %\ 1/2 
KEOSOT |) our | REO” (31b) 
K b, K 


Consider the sliding function (11) for the y-direction with b = 1. Taking its 
time derivative gives 


S, =f, + byty — Py t ce, (32) 


Using Eq. (30) and solving for 5. = 0) the control law u, is found as 
iy == (—f, +5 -cé)) (33) 


Similarly for the x-direction 


iy == (X4 — ce) (34) 
However, these control signals only work for the nominal subsystems. Using 
the Lyapunov function Vi=3S? (i=~,y), in Fallahi et al. (2018) itis shown 
that the following controllers ensure the convergence of the uncertain 


system: 
7 1 
Uy = Ux — — K,sgn(S,) (35a) 
. 1 
‘i= t= 7 Kusen(Sy) (35b) 
y 
with 
Ky =A t+ (Ax — 1) |b sits (36a) 


KRHA ty re a=) 


= *\ 1/2 = *\ 1/2 
where A, = (“ae ) A= (= ) F Fo Son and y > 0. 


K K 


b iiy| (36b) 
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3 Beating-heart surgery 


Beating-heart surgery has significant advantages over conventional 
arrested-heart surgery. However, the fast motion of the beating heart intro- 
duces a challenge to the surgeon (human operator). To overcome this obsta- 
cle, a mechanical heart stabilizer (Bachta et al., 2009b) is usually used to keep 
the beating heart from moving. However, this device can only reduce the 
motion in a localized area on the exterior surface of the beating heart. To 
minimize the risks of tool-tissue collision and tissue injury, a robot-assisted 
system is necessary to automatically provide compensation for the fast beat- 
ing heart’s motion, so that to assist the human operator to perform operation 
accurately and precisely. Indeed, if the robotic system can move a surgical 
tool in synchrony with the target tissue while the heart beats, the oscillatory 
forces between the surgical tool and heart tissue may be small, and the 
human operator can then perform the surgical procedure as if the beating 
heart is stationary. 

The robot-assisted system, however, introduces another issue: haptic 
feedback. As the human operator cannot make contact with the surgical 
tool, the tool-tissue interaction forces cannot be perceived by the human 
operator directly. To provide haptic feedback to the human operator, in 
some robot-assisted systems, a force sensor is attached to the end of the sur- 
gical robot to register forces. When the surgical robots’ motions are synchro- 
nized with the hearts motions, the force sensor inertia will cause oscillatory 
forces, which should not be transmitted to the human operator. In other 
words, the haptic feedback should only contain the nonoscillatory portion 
of the environmental forces. To date, the state-of-the-art research on robot- 
assisted beating-heart surgical systems has been studied to compensate for 
the hearts motion and reflects nonoscillatory haptic forces to the human 
operator. 


3.1 Related work 


Depending on the intended surgical procedures, several robot-assisted 
surgical systems have been developed, which can be mainly categorized into 
two groups based on the interaction modes with the human operator 
(Tavakoli, 2008): handheld surgical robotic systems and teleoperated surgi- 
cal robotic systems. 

Handheld surgical systems require the human operator to hold the sur- 
gical system directly, which includes an actuator and a surgical tool attached 
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at the end of the system so that the surgical tool can move with respect to the 
handle (Kettler et al., 2007; Yuen et al., 2009; Zahraee et al., 2010). 

Different from the handheld surgical systems, a teleoperated surgical sys- 
tem involves a master robot that provides position and/or force commands 
and a slave robot that receives those commands and executes tasks on the 
heart tissue (Bowthorpe et al., 2014a, b). These systems have been shown 
to offer lots of advantages such as dexterity, fine and remote manipulation 
capability, and haptic feedback capability for the human operator. The 
DaVinci surgical robotic system (Guthart and Salisbury, 2000) by Intuitive 
Surgical Inc. (Sunnyvale, California, United States) is one of the most prom- 
inent commercial teleoperated surgical systems. 

Teleoperated surgical systems can be divided into two categories 
depending on their features. In a unilateral teleoperation system, the human 
operator loses the sense of touch. In contrast, in a bilateral teleoperation sys- 
tem, the human operator can feel the interaction force between the slave 
robot and what it is touching, enabling the human operator to efficiently 
manipulate the master robot to provide appropriate commands. 

Conventional surgical tools used in robot-assisted systems for cardiac 
surgeries are short and rigid. Surgical tools like scissors, forceps, and graspers 
are usually mounted on the end of the systems to perform surgical tasks. 
However, during intravascular interventions and minimally invasive surger- 
ies, the dexterity of surgical robots can be enhanced by using flexible, thin, 
and lightweight surgical tools such as catheters while also reducing trauma, 
which is a benefit for postoperative recovery (Tavakoli et al., 2007). These 
flexible surgical tools can be combined with the above robot-assisted systems 
to perform intended surgical procedures (Kesner and Howe, 2011b; 
Khoshnam and Patel, 2017). 


3.2 Measurements and feedbacks 


To address the issue of beating-heart motion compensation, several types of 
sensors have been used to capture the position of the heart, so that the human 
operator perceives visual feedback of the surgical site through sensors, and 
the robotic surgical instruments track the beating heart’s motion by utilizing 
the measured heart positions. 

Nakamura et al. (2001) adopted one color camera to provide colorful 
visual feedback and one monochrome high-speed camera to measure the 
heart position. The human operator utilized the guidance of those two cam- 
eras to demonstrate automatic tracking of a point on the heart that was lit by 
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laser. Ginhoux et al. (2004, 2005) and Gangloff et al. (2006) measured the 
2D cardiac motions by using a 500-Hz camera to avoid aliasing. Richa et al. 
(2010, 2011) and Yang et al. (2015) extended 2D position tracking to 3D 
position tracking using a stereo camera system. In addition, the high-speed 
camera has been employed in other literatures about beating-heart surgery as 
well (Bachta et al., 2009a, 2011; Nakajima et al., 2014; Ruszkowski et al., 
2016). These sensors provided real-time and accurate position information 
to compensate for the rapid movement of the beating heart. However, 
high-speed cameras can only visualize the outer surface of the heart and 
are not appropriate for surgeries performed inside the heart. 

In Schweikard et al. (2000), a pair of X-ray cameras and an infrared track- 
ing system were combined to obtain the positions of the internal markers 
attached to the heart tissue. Similarly, Mansouri et al. (2018) used an infrared 
tracker system to locate the 3D positions of the heart. These methods require 
passive markers attached on the point of interest of the heart tissue, which 
may be affected during tool-tissue interaction and further operations. 

Another common sensor used for guiding intracardiac beating-heart 
repairs is US machine. Yuen et al. (2008, 2009) developed a 3D 
US-guided motion compensation system for beating-heart mitral valve 
repair. Kesner and Howe (2014) applied a robotic catheter system combin- 
ing US guidance and force control to perform cardiac tissue ablation. 
Bowthorpe and Tavakoli (2016a, b, c) and Cheng and Tavakoli (2018b) 
developed a master-slave teleoperated system and combined US images with 
various controllers to compensate for the beating heart’s motion. The acqui- 
sition and processing of US images cause a large time delay, which needs to 
be compensated for via control. 

In addition to various image-based sensors, nonimage-based sensors such 
as force sensors and sonomicrometry crystals are proposed to solve the prob- 
lem of motion compensation and/or haptic feedback. 

Moreira et al. (2012, 2014b), Dominici and Cortesao (2014a, b), and 
Cortesao and Dominici (2017) utilized force sensors to compensate for 
the physiological motion by controlling the contact forces to track the 
desired ones. These methods were assumed that the surgical robot has some- 
how been initially controlled to come into contact with the heart tissue, and 
the control goals are maintaining contact between the tool and the tissue. 

Tuna etal. (2013) and Bebek and Cavusoglu (2007) used sonomicrometry 
crystals to track the beating-heart motion in real time and generalized 
adaptive predictors to predict the hearts motion. By putting six and one 
sonomicrometry crystals under and on the surface of the heart, the 
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electrocardiogram (ECG) biological signals of the heart surface can be mea- 
sured based on the transmission and reception of US signals. This technique is 
feasible as the heart position can be captured through blood, although the cal- 
culation is complex and time consuming. 


3.3 Control 


Various position-, force-, and impedance-based control methods have been 
proposed for enabling tool-tissue motion compensation for beating-heart 
surgery and nonoscillatory haptic feedback in teleoperation systems. 


3.3.1 Position-based control methods 

The position-based controllers need the current beating heart’s position and 
can be classified into predictive feed-forward controllers and predictive 
feedback controllers. Predictive feed-forward controllers use the hearts 
position as the set point to move the surgical tools. Predictive feedback con- 
trollers not only need the heart’s current position but also take the tracking 
error into account. 

Bebek and Cavusoglu (2007) proposed a control algorithm based on the 
previous quasiperiodic heart motions which are ECG signals detected 
through sonomicrometry crystals. Yuen et al. (2009) collected the heart 
positions from US images, and employed an extended Kalman filter (EKF) 
to compensate the time delay caused by image acquisition and processing. 
This method took advantage of the quasiperiodicity of the heart motion 
and modeled the heart motion as a time-varying Fourier series. Many of 
the predictive feed-forward controllers are used for handheld systems. 

To further compensate for the position tracking errors, predictive feed- 
back controllers are used. Bowthorpe et al. (2014b) developed a teleoperation 
system and proposed a feedback controller with a modified Smith predictor 
to ensure the distance between the surgical tool and the heart at desired values 
as commanded by the human operators hand position. Bowthorpe and 
Tavakoli (2016c) presented three different Smith-predictor-based feedback 
controllers to tackle issues such as time delays, different measurement rates, 
and unregistered sensor data. 


3.3.2 Force-based control methods 

Force control methods are benefit for applications that require contact such 
as heart biopsy with controlled depth. Considering the process of tool-tissue 
interaction in robot-assisted beating-heart surgery, precisely applying forces 
on the beating-heart tissue and enabling the surgical robot to comply with 
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the beating heart’s motion simultaneously is important. Therefore, several 
force control methods were proposed. 

Moreira et al. (2012, 2014b) proposed a force control method using 
active observer based on a viscoelastic interaction model to compensate for 
the physiological motion. Dominici and Cortesao achieved motion compen- 
sation by designing a cascade model predictive control architecture with a 
Kalman active observer (Dominici and Cortesao, 2014a, b), and a double 
active observer architecture (Cortesao and Dominici, 2017). These systems 
use similar feedback controllers. In addition, Yuen et al. (2010) and Kesner 
and Howe (201 1a, 2014) separately combined the US image guidance with 
a force controller incorporating a feed-forward term containing the estimated 
motion of the beating heart. These methods incorporated position control 
and force control to achieve beating-heart motion compensation. 

Much of the earlier work focus on handheld systems instead of 
teleoperation systems, which are possible to enable haptic feedback to the 
human operator. Haptic feedback during a surgical operation is significant 
for the human operator to be able to accurately execute the surgical 
tasks especially in beating-heart surgeries involving tissue cutting and sew- 
ing, grasping, dissection, etc. (Wagner et al., 2007). During the operation 
of such surgical tasks, the tool-tissue interaction forces should be within a 
safety range to avoid potential tissue injury. To enable the human 
operator to perceive appropriate haptic feedback under contact, bilateral 
teleoperation systems were studied. As discussed earlier, the issue of oscilla- 
tory haptic feedback caused by force sensor inertia should be considered. For 
instance, Nakajima et al. (2014) performed haptic feedback using an 
acceleration-based bilateral control system. Mohareri et al. (2014) developed 
a force feedback control system for bimanual telerobotic surgery using the 
DaVinci surgical system (Intuitive Surgical Inc., Sunnyvale, California, 
United States). 


3.3.3 Impedance-based control methods 

Most successful applications of robot-assisted surgical systems to date have 
been performed based on the position or force control, in which the surgical 
robot is treated essentially as an isolated system. However, in robot-assisted 
beating-heart surgeries, control of the dynamic behavior between the sur- 
gical robot and the beating-heart tissue is also required. Given the beating 
heart contains inertial objects, the surgical robot and the beating heart can 
be expressed as an impedance and admittance, respectively (Hogan, 1984, 
1985). Generally, the beating heart can be regarded as a source of 
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disturbances “‘to the surgical robot, and the disturbance response” of the sur- 
gical robot can be modulated to control the dynamic behavior between the 
surgical robot and the beating-heart tissue by varying the parameters and/or 
structure of the impedance. 

Zarrouk et al. (2010) proposed an adaptive control architecture based on 
the model reference adaptive control to solve the 3D physiological motion 
compensation in beating-heart surgery. A reference impedance model and 
an adaptive controller were designed for the surgical robot. In Cheng and 
Tavakoli (2018a, b), Sharifi et al. (2018), and Cheng et al. (2018), the model 
reference adaptive control was applied to a bilateral teleoperation system. 
The authors designed two reference impedance models for the master 
and slave robots to simultaneously make the slave robot compensate for 
the heart motion and ensure the human operator to perceive nonoscillatory 
haptic feedback. The main advantage of impedance-based control system is 
the desired performance can be achieved via appropriate parameter adjust- 
ment of the reference impedance models without any measurement or esti- 
mation of the beating heart’s motion. In the following, two reference 
impedance model-based teleoperation systems are presented to describe 
the applications of observation and feedback control in robotic systems 
for beating-heart surgery. 

Bilateral impedance control: The developed bilateral impedance-controlled 
teleoperation system is shown in Fig. 7. Here, ff, is the interaction force 
between the master robot and the human operator and f, is the interaction 
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Fig. 7 The block diagram of the bilateral impedance-controlled teleoperation system 
with two reference impedance models for the master and slave robots. 
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force between the slave robot and the beating heart. They are measured 
directly through two force sensors. Also, X,;, and X,.; are the desired position 
for the master and slave robots and x,, and x, are the actual position of the 
master and slave robots, respectively. The controllers receive the position 
errors between the desired positions generated by the reference models 
and the actual positions read from the robots and then output torque 
u,, and u, to the robots. 

The reference impedance models for the master and slave robots are 
designed and can be expressed as 


mindinay + Entry + knee, Sr, — Reh (7) 


1X a PG FR, (38) 
where Riek = Xrop — kpX,, and k, is the position scaling factor. In the earlier, 
k,, cand ky, Cn, M,, are the virtual stiffness, damping, and mass parameters of 
the slave, and master impedance models, respectively. Also, ky is the force 
scaling factor. 

In order to accomplish the desired objectives, the parameters for the two 
reference impedance models should be adjusted appropriately. The damping 
ratios and the natural frequencies of the reference impedance models are 
introduced. Given one of the stiffness, damping, and mass parameters, the 
rest two parameters can be calculated through ¢€;=¢/2./mjkj and 


On, = \/ki/m; (i = m for the master, and i = s for the slave). To ensure 
the impedance models have fast behaviors in response to the force inputs 
and small overshoots in response to the step force inputs, the damping ratios 
are set as 0.7. 

The master impedance model (37) should be designed to provide feed- 
back of the nonoscillatory part of the slave-heart interaction force for the 
human operator. For this purpose, the stiffness parameter (k,,) of the master 
impedance model should be chosen small, and the natural frequency of the 
master impedance model (@,,,) should be much lower than the frequency of 
the beating heart w);, which has a range of 6.28—10.68 rad/s (@,,, <q). 

The slave impedance model (38) should be adjusted such that the slave 
robot complies with the physiological force during the interaction proce- 
dure. The stiffness of the slave impedance model (k,) should be moderate 
as a too small value will lead to a super flexible slave robot and too large 
value will make the slave robot very rigid. The natural frequency of the 
slave impedance model (@,,) should be much greater than the frequency 
of the heart (@,,>>q@,). Detailed parameter adjustments can be found in 
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Table 2 Parameter adjustments of the master and slave impedance models 





Characteristics Master impedance adjustment Slave impedance adjustment 
Stiffness k,, =5 N/m k, = 100 N/m 

Damping ratio 6g = 07 €,= 0.7 

Natural frequency @,,,, =0.5 rad/s yn, = 50 rad/s 

Damping and mass _ m,, = 20 kg, ¢,, = 14.Ns/m sm, = 0.04 kg, c, = 2.8 Ns/m 
Scaling factor kp= 1 kp = 1 





Cheng et al. (2018). The adjusted parameters of the two impedance models 
are listed in Table 2. 

By focusing on the direction of the major component of heart motion the 
proposed bilateral impedance-controlled teleoperation system (with motion 
compensation) was compared to the regular direct force reflection (DFR) 
teleoperation system (without motion compensation) (Liu and Tavakoli, 
2011), which reflects the entire slave-heart contact force to the human oper- 
ator and requires the operator to take care of the motion compensation man- 
ually. Fig. 8 shows the positions and forces during slave-heart interaction. 

Without motion compensation, it is difficult to synchronize the slave 
robot with the beating heart. Comparatively, with motion compensation, 
the oscillatory force of the moving tissue was filtered, and only a stable base- 
line contact force was perceived by the human operator. Also, the position 
deviation between the slave robot and the heart during contact was very 
small. The human operator was easier to perform tasks, and the human- 
master interaction forces were steady and small. 

Ultrasound image guidance and robot impedance control: In the earlier, as the 
stiffness of the slave impedance model (k,) is chose to be moderate, the force 
applied on the heart tissue will not be very large, which limits the system’s 
application. To this end, Cheng and Tavakoli (2018b) proposed that to 
combine the robot impedance control with US imaging algorithm to 
achieve the two objectives of the system (Fig. 9). The US imaging-based 
control algorithms are used to make motion compensation. The impedance 
model for the master robot is designed to provide the human operator with a 
feeling of operating on an idle heart. 

In the slave site, an US imaging machine is used to obtain the position of 
the beating heart x,. The summed position of the master robot x,, and the 
heart x, transmitted to the slave robot as a reference signal X;ef (=Nat Bel 
And then a slave controller is used to make the position of the slave robot x, 
follow its reference trajectory X;,. In the master site, the human-master 
interaction force fj, and the slave-heart interaction force f, are transmitted 
directly to a reference impedance model, which as we discussed earlier 
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Fig. 8 Contact forces and positions (A), (C) without motion compensation, and (B), (D) with motion compensation. 
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Fig.9 The teleoperation system with US image guidance and robot impedance control. 


can filter out the high-frequency portion off, and achieve fj, equals the fil- 
tered f,. The impedance model generates a reference position x, for the 
master robot to follow. 

For the sake of brevity, we will focus on the direction of the major com- 
ponent of heart motion. The motion compensation system is designed to 
make the slave robot to follow the combined trajectory of the master robot 
and the beating heart. The beating-heart position can be calculated based on 
the position of the slave robot and the measured robot-heart distance cap- 
tured by US imaging along the surgical tools axis. The slow sampled robot- 
heart distance can be measured directly from each US image (the detailed 
algorithm is in Cheng and Tavakoli, 2018b). As the low sampling rate of 
the US image, the measured robot-heart distance needs to be upsampled 
to the system control sampling rate first by using cubic polynomial interpo- 
lation. Then, the delayed upsampled heart position can be obtained by 
delaying the position of the slave robot and adding it to the upsampled 
robot-heart distance. To further compensate for the time delay, the delayed 
quasiperiodic heart position is modeled as a time-varying Fourier series and 
predicted by an EKF. The reference impedance model for the master robot 
is designed the same as shown in the bilateral impedance control. 

In experiments, the proposed method (Fig. 10C and F) was compared 
with the regular DFR teleoperation without and with automatic motion 
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Fig. 10 Position and force results (A) and (D) for the DFR teleoperation system without AMC, (B) and (E) for the DFR teleoperation system with 


AMC, and (C) and (F) for the proposed teleoperation system. 
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compensation (AMC). The DFR teleoperation system without AMC 
(Fig. 10A and D) requires the human operator to perform motion compen- 
sation manually, while the DFR teleoperation system with AMC (Fig. 10B 
and E) compensates for the hearts motion automatically. 

In Fig. 10A and D, the slave robot tracks both positions and forces of the 
master robot during the entire operation. However, the tracking of the 
beating-heart motion is poor as the human operator must manually com- 
pensate for the heart motion. Moreover, the oscillatory human-master inter- 
action force suggests that the human operator receives unsteady haptic 
feedback, which makes it more challenging to synchronize the motion of 
the slave robot with the hearts motion. In Fig. 10B and E, the position track- 
ing result is much better in this case than that in the first case. Nevertheless, 
the haptic feedback to the human operator is still oscillatory. An oscillatory 
motion with small amplitude remains in the master robot position due to the 
poor quality of haptic feedback. In Fig. 10C and F, the position tracking 
result is significantly better than that in Fig. 10A and D. Both the position 
and force of the master robot are much steadier as the oscillatory portions 
have been filtered using the proposed impedance model for the master 
robot. The human operator is able to operate on a beating heart without 
manual compensation, and simultaneously has a sense of operation on a 
seemingly idle heart. 





4 Discussion 


The discussion of this chapter is twofold: Section 2 addresses the nee- 
dle insertion procedures and Section 3 discusses the challenges in beating 
heart surgery. The control strategies mentioned in Section 2, show the appli- 
cation of the sliding mode control in needle steering. The 2D controller in 
Section 2.5.2 is supplied with the needle deflection error obtained from 
ultrasound images and switches the system to the proper mode for reducing 
the targeting error. The constraints on switching parameters are derived 
using kinematic unicycle equations for the needle to ensure the stability 
of the system and convergence of the error. Similarly, the 3D controller 
in Section 2.5.3 finds the desired value of the needle base angle to steer 
the needle on the desired path in the 3D environment and to reduce the 
number of rotations and the tissue trauma. In this method, for each sub- 
system, a sliding surface is defined, and the two sliding surfaces are com- 
bined. In these methods the controller is not dependent on the exact 
knowledge of the system parameters, and only the maximum value of the 
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needle path curvature is needed. These structures represent simple and non- 
model-based control strategies to improve needle tip positioning. 

The sliding mode controller in Section 2.5.4 is designed for a special 
framework, where the 3D needle equations are divided into two subsystems, 
representing the in-and out-of-plane motions. Each subsystem is considered 
as a planar switching system with two modes determining the two possible 
bevel orientations, which are 180 degrees apart. Assuming the switching 
between the two modes is performed according to some duty cycle period 
in a PWM framework, the performance of each subsystem is approximated 
by the averaged subsystem in the PWM period. Each averaged subsystem has 
its virtual input, for which controllers are designed using sliding mode con- 
trol technique. 

These mentioned methods use the position data obtained from ultra- 
sound images. However, since the path traveled by the needle depends 
on the needle tip orientation, having information about the needle tip ori- 
entation will be helpful in the controller design process. Due to the small 
diameter of the needle and the low resolution of the images, it is not possible 
to retrieve the orientation information from the ultrasound images. This 
problem is dealt with by using state observers as explained in Section 2.3, 
where linear and nonlinear observers are introduced for estimating the nee- 
dle tip orientation. In this method, nonlinear transformations are applied on 
a 3D unicycle model. Since these equations do not satisfy the Lipschitz con- 
tinuity condition, designing a convergent observer is not possible. Further 
studies are required in this field for designing nonlinear observers and their 
stable combination with controllers. 

Regarding the beating heart surgery, in Section 3, two impedance-based 
teleoperation systems were presented to achieve heart motion compensation 
and nonoscillatory robot-heart interaction feedback simultaneously. The 
bilateral impedance-controlled teleoperation system designed two reference 
impedance models for the master and slave robots, respectively. By tuning 
the parameters of the impedance models, the slave robot was able to comply 
with the movement of the beating heart, and the oscillatory portion of the 
slave-heart interaction force was filtered out, which made the human oper- 
ator only perceive the nonoscillatory contact force. In the experiments, 
compared to the conventional DFR teleoperation system, the proposed sys- 
tem was able to provide the human operator a feeling of operating on an 
arrested heart and make the anchor deployment task much easier to perform. 
It should be noted that for the parameters of the slave robot’s impedance 
model, they were adjusted to be moderate because too small values would 
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not apply enough forces to the heart and too large values would lead to the 
motion compensation be inaccurate. Therefore, this system is more suitable 
for surgeries that require less slave-heart contact forces such as mitral valve 
annuloplasty, blunt resection, ablation, etc. 

To extend the applications for beating-heart surgery, the robot imped- 
ance control was combined with US image guidance, and the second system 
was proposed. This teleoperation system retained the reference impedance 
model for the master robot to attain nonoscillatory force feedback but rep- 
laced the reference impedance model for the slave robot with US image 
guidance for position control purposes. In this system, the slave robot pro- 
vided motion compensation for the heart motion by following the position 
of the heart which was measured through US images. The low frame rate 
and time delay caused by image acquisition and processing were addressed 
by cubic polynomial interpolation and EKF, respectively. As the reference 
trajectory for the slave robot is the sum trajectory of the master robot and 
beating heart, large slave-heart contact force can be exerted on the heart tis- 
sue by increasing the master robot’s position commands. Consequently, the 
applications of this system can be extended to surgeries that need large slave- 
heart contact forces such as tissue cutting, penetration, and so on. 





5 Conclusion 


The subsections in Section 2 provided an overview of the related 
observer and controller methods proposed for robot-assisted, image-guided 
needle steering. The goal of these approaches is to improve the needle tip 
positioning and increase the efficiency of the clinical needle insertion pro- 
cedures. From the control perspective, the main challenges in designing a 
controller for needle/tissue system arise from the under-actuation property 
and the nonholonomic constraints imposed on the needle kinematics. 
Moreover, due to the small diameter of the needle and the low resolution 
of the ultrasound images, it is not possible to retrieve the orientation infor- 
mation from the ultrasound images, which can be dealt with by using state 
observers. The proposed control methods can be further expanded to have 
moving targets and obstacles, online estimation of the system parameters and 
observer/controller combination for trajectory tracking in the 3D environ- 
ment. Further developments and experiments are required to verify the 
application of the proposed structures in clinical settings. 

In Section 3, another application of robotic assistive systems in beating- 
heart surgery is discussed. A robot-assisted beating-heart surgical system has 
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the potential to improve the outcome of many surgical procedures per- 
formed on the heart. There are different ways to control such a system as 
each surgical procedure has different requirements. For instance, the proce- 
dure could be ablation which requires small exerted force or tissue cutting 
which requires large exerted force. This would affect the choice of the 
motion-capture module and, in turn, affects the choice ofa controller. Based 
on the requirements for a specific surgical procedure, the robot-assisted 
beating-heart surgical system can be designed. The controllers for the system 
should automatically compensate for the beating heart’s motion while pro- 
viding nonoscillatory haptic feedback for the human operator. 
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Abbreviations 


AI artificial intelligence 

CABG coronary artery bypass grafting 

CAD — computer aided design 

CEM Centre of Experimental Medicine 

DOF degrees of freedom 
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Zbigniew Religa Foundation of Cardiac Surgery Development) 

HCR hybrid coronary revascularization 

PVA PortVisionAble (Robin Heart robot) 
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1 Introduction 
1.1 From telecommunication to teleaction 


Modern medical techniques are now successfully implemented in order to 
raise standards, improve access to services, and introduce staff optimization 
in the care, treatment, and rehabilitation of patients. Everyone realizes that 
the challenges of demographic change, increased needs, and social expecta- 
tions cannot be solved with the current health care system. There is a short- 
age of qualified medical personnel, and human and financial capital. 
Medical services (often in emergency mode) should be provided at the 
right time and in a place often away from competent medical centers. Both 
organizational and technical innovations are necessary. The development of 
medical robotics is an opportunity to solve some of the problems; this is 
similar to the early stage of the development of industrial civilization, when 
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the automation of production processes solved the problem of the lack of 
hands to work and adequate production efficiency. After the progress of 
tele-communication, i.e., sending information at a distance now is the time 
for the development of teleaction, i.e., remote transmission of the action. 
Robots are necessary for this. 

Robot is one of the few words of Slavic origin to enter the global language 
of modern science and technology. Robotics is a technical discipline devoted 
in principle to mechanisms—robots performing selected human activities. 
The robot, unlike the automaton, is a smart combination of perception (sen- 
sors) with action (mechanical work). The robot consists of a mechanical 
manipulator, a control, and a programming system. A fully autonomous robot 
acquires and processes information and takes specific physical action. 

Medical robotics, as a technical discipline, deals with the synthesis of 
certain functions of the doctor or nurse by means of using some mech- 
anisms, sensors, actuators, and computers. It includes the manipulators 
and robots dedicated to support surgery, therapy, prosthetics, and reha- 
bilitation. Medical robots improve quality and create an opportunity to 
introduce new standards. Automated diagnostic devices (e.g., tomogra- 
phy) or radio-therapeutic devices are already a well-spread standard. 
Other applications of robots, e.g., surgical and rehabilitation robots, 
require control through direct supervision or remote control. Will it 
be possible to automate all diagnostic or surgical procedures? To a large 
extent, it depends on the development of sensor techniques and artificial 
intelligence. 

One of the pioneers of innovative surgery and robotics, Dr. Richard 
Satava from the University of Washington and the Defense Advanced 
Research Projects Agency (DARPA), predicts that in the next 40-50 years, 
operations will be completely automated. The role of the surgeon will evo- 
Ive, including the management of a full information system built around the 
surgical environment. “The future of technology and medicine is not in the 
blood and guts at all, but in bits and bytes” (Sant’ Anna et al., 2004). “A robot 
is not a machine—it is an information system.” “One of the principle advan- 
tages of the robotic surgical system is the ability to integrate the many aspects 
of the surgical care of the patient into a single place ... and at a single time” 
(Satava, 2011). 

The first description ofa surgical robot can be found in Alexander’s paper 
(Alexander, 1974). The first tests were based on adapted industrial robots, 
used for brain biopsy and orthopedic surgery. The challenge of constructing 
a robot for heart surgery (and other soft tissues) was undertaken by two 
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competing American companies from California: Intuitive Surgical (da 
Vinci) and Computer Motion (Zeus, AESOP). Robotic-assisted laparo- 
scopic surgery (RALS) has evolved since its inception in 1985. Since the 
introduction (US Food and Drug Administration approval in 2000 for adult 
and pediatric surgeries) of the da Vinci system (Intuitive Surgical, Sunnyvale, 
California), most cases are now dedicated toward urology and urologic 
oncology procedures. Disadvantages of RALS include relatively longer 
operative times, absence of tactile feedback, and instrument collisions when 
traversing broader operative fields (Williams et al., 2014). 

Minimally invasive surgical endoscopic procedures require new mecha- 
tronic and robotic tools. Surgical robots are increasingly used. A million 
operations per year have been achieved using the market leader da Vinci 
(Intuitive Surgical, USA) (www.intuitive.com). The robot, constructed 
30 years ago with a view to cardiac surgery, is today mainly used for urologi- 
cal and gynecological operations. The heart, as the object of operation, is still 
a technical challenge. 

The Robin Heart robot, developed in Poland in Zabrze, thanks to the 
innovations being developed, will bring robotic technology closer to sur- 
geons’ expectations in this field. 

The benefits of using surgical robots in preference to conventional open 
surgery include: 

a. decreased hospitalization time; 

b. lowered complication rates; 

c. reduced postoperative pain; 

d. improved cosmetic results; and 

e. faster return to normal daily activities. 

Robotic systems are not yet available for the full spectrum of cardiac disease 
surgery. Gao indicates many contraindications also for other thoracic sur- 
gery. In respect to the ever-advancing surgical robotic systems, with a price 
tag of several million dollars, their costs seem prohibitive, let alone the costs 
of maintenance and upgrading. ... “Absence of haptic sensation and conse- 
quent loss of tactile feedback impair the manipulation of tissue as well as 
suturing material, which may be the most technical obstacle for surgeons 
to perform delicate suturing because of their inability to judge qualitatively. 
Lack of more compatible instruments for retraction, exposure and visioning 
increases the reliance on tableside assistance to perform certain part of the 
surgery such as knotting, retracting, replacing instruments, etc.” ... Much 
remains to be done before full potential of robotic cardiac surgery can be 
realized (Gao, 2014). 
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Currently, complex mitral valve repair or replacement (Chitwood et al., 
1997; Gao et al., 2012; Mohr et al., 2001; Mehmanesh et al., 2002), atrial 
septal defect repair (Argenziano et al., 2003; Torracca et al., 2001), coronary 
artery bypass grafting (CABG) on arrested heart (de Canniere et al., 2007; Falk 
et al., 2000; Loulmet et al., 1999), or on beating heart can be performed with 
the use of robotic assistance. New possibilities for heart treatment have 
been created; as Srivastava explains: “Hybrid coronary revascularization 
(HCR) is a treatment strategy for the revascularization of multi-vessel coro- 
nary artery disease that utilizes minimally-invasive CABG techniques in 
conjunction with percutaneous coronary intervention, integrating the 
advantages of both.” “The Heart Team approach merges the insight and 
skill-sets of both the cardiac surgeon and the interventional cardiologist to 
allow for optimized revascularization based on the coronary anatomy and 
clinical characteristics of the patient. The limitations of this approach include 
the availability of hybrid operating suites and the advanced technologies and 
skill sets required for the performance of HCR. Additionally, specific features 
of the approach such as optimal anti-coagulation strategies and sequence 
of revascularization remain to be elucidated” (Srivastava et al., 2014). 

New heart treatment options require new ideas and appropriate tools. 
Robin Heart is an example of a robot that is created to solve the problems 
described. The heart remains a challenge for the constructors of surgical 
robots. 

The chapter is devoted to the description of research and construction 
works on the development of Polish Robin Heart robots, which the author 
and the team have been running since 2000. The scope of FRK experience is 
a good example of the multidisciplinary teamwork to create a modern sur- 
gical tool, testing new ideas on the borderline of medicine and techniques, 
mechanics, and software. and to overcome the natural limitations of man 
concerning movement, precision, access to tissues requiring surgical inter- 
vention and operation space, and distance between the doctor and the 
patient, as well as the “distance” between knowledge and practice. 


1.2 Surgical robots in Poland—Important dates and facts 


In Poland, the interest in the development of robotics was associated 
with doctors—mainly Silesian surgeons—such as Religa, Bochenek, and 
Witkiewicz: 
2000 Prof. Zbigniew Religa and Zbigniew Nawrat start the Robin 
Heart project. 
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2001 Prof. Andrzej Bochenek in Katowice implements the AESOP 

assisting robot (Computer Motion, US). 

2002 Prof. Andrzej Bochenek performs first 10 cardiac surgery opera- 

tions in Poland by ZEUS robot (borrowed from Computer 

Motion, US). 

2010 The first da Vinci robot appears in Poland. During the first half of 

2011. with the assistance of a robot surgeon from the Provincial Specialist 

Hospital in Wroclaw under the direction of Prof. Wojciech Witkiewicz, 

36 operations were performed in the field of gynecology, urology, and 

vascular surgery. To date, more than 300 have been performed. 
Currently, there are six da Vinci robots in Poland, mainly in private 
hospitals. 

Analysis [average data from countries with high HDI (human develop- 
ment index), after rejected extreme data from Poland and the United States] 
shows acceptance of the index 1 robot for 1.15 million inhabitants is 
considered justified at the current stage of development of da Vinci robot 
applications. This would mean that there should be 34 robots in Poland, 
including four robots used in cardiac surgery (Kroczek et al., 2017). 
According to the plan, the first Polish Robin Heart robots will appear on 
the Polish market soon; maybe they'll fill this gap. 





2 Surgical robots 


The telemanipulator control system works as a master-slave manipu- 
lator system, reflecting the movements of the operator (surgeon) on the 
movement of the arm and tools by developing appropriate control signals 
for its drives. According to the assumptions, the control provides the 
required accuracy, it allows the scaling of the set value to increase the posi- 
tioning accuracy, and also eliminates the operator’s hand tremor. 

The control system of the robot’s drive units allows the robot’s effector 
to perform specific tasks. The manipulator drive units are powered from 
power amplifiers in the manner imposed by the controller. The control sys- 
tem (the analyzed signals are n-dimension vectors) creates a closed control 
system, evaluating the current compliance of the actual implementation 
of the tasks with the planned ones. If the priority is to reach the position 
(e.g., when the robot does not come into contact with the environ- 
ment)—the positional control is chosen. Its use requires good quality image 
information of the operation field for the telemanipulator operator. If the 
priority is to accomplish the task (despite the occurrence of obstacles), force 
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control is used. Its use requires real-time information about the value of the 

force action of the tool in the space of the operation. There are currently no 

suitable sensors for surgical robots—force sensors suitably small, precise, and 
resistant to critical working conditions of tools in the human body. 

In medical robots, it is very important to define the hierarchy of man- 
agement and to enable patient and staff protection in every situation. In 
the event of a robot failure, power outage, or other critical situations, doc- 
tors withdraw the robot (constructors must choose a technical solution that 
allows this) and continue operation with classical methods. Creating a con- 
trol program requires the use of data on the phenomena of mechanical inter- 
action with the tissue (empirical), simple and inverse kinematics of the 
mechanical system, and characteristics of the drive system determining, 
for example, accuracy (resolution) for each degree of freedom. 

The surgeon uses both conditioning and coordination motor skills dur- 
ing work. The comfortable position and way of working in the robot con- 
trol console allows the overcoming of ergonomics problems of the surgeon’s 
work. Performing precise motion is associated with proper planning and 
online control. Correcting the position and functions of the tools requires 
a good image quality and all current additional information from the oper- 
ating field, including force feedback. 

The information is processed during telemanipulator control. The oper- 
ator of a surgical robot making decisions and performing specific physical 
tasks with a tool uses: 

(1) medical data and history of patients (optimization through 
personalization); 

(2) diagnostic data, factual data based on facts, i.e., current information on 
geometry and on the state of tissues (optimization by defining the 
operating space); 

(3) feedback of the tool’s response to tissues through visual observation 
(image analysis) and/or force coupling (optimization of motion and 
action by the senses); 

(4) a set of data characterizing the current status of vital functions of the 
patient’s organs during surgery (optimization by interactive evaluation 
of the patient’s condition in real time); and 

(5) information obtained in the process of education and practice (optimi- 
zation through knowledge and experience). Supported by a planning 
system based on computer simulations, they can be extended, updated 
using artificial intelligence (AI) and advisory programs, which are the 
sum of the surgeons’ and potentially robots’ experiences of similar cases. 
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The effect of the operation (accomplishment of the assumed goal) should be 
measurable and verified—then it can be used to develop the standard of the 
performed service, and in the future may lead to the automation and inde- 
pendence of robots. 





3 Robin Heart 


The work presented here is an attempt to summarize the research and 
development of the Polish surgery robots project carried out by a multi- 
disciplinary team led by the author. The results of the project initiated by 
the author are the family of Robin Heart robots and universal mechatronic 
tools series Robin Heart Uni System for use during minimally invasive 
surgery on the heart and other soft tissues. The Polish project began in 
2000. It is possible to find reports on the progress of work (cited partially 
below) available on the Internet (edited by the author of this chapter, 
manager of the Robin Heart project) the book series Medical Robots, 
Advances in Biomedical Technology, and the scientific journal Medical Robotics 
Reports. The most important summary is presented in a book published in 
Polish (Nawrat, 2011). 

This chapter presents the design, prototyping, and testing of innovative 
surgical tools. An assessment of the achieved results and prospects for devel- 
opment of the Robin Heart project robot against the current state of scien- 
tific knowledge and global experience in the field of robotic surgical systems 
are presented. 

The process of projecting a robot starts by determining the tool-tissue 
reaction (mechanical characteristic, the forces for specific operations, and 
dynamic analysis of the work of a tool) and the person-tool man-machine 
contact (kinematic analysis of the surgeon’s motion). The surgeon’s motion 
and tool trajectory in the natural environment are analyzed with the use of 
optical biometry techniques. The forces applied during the impact of tools 
on tissue during typical surgical activities are measured in simulation of nat- 
ural conditions. The construction assumptions, as well as the functionality 
and ergonomics of the innovative tools, are verified experimentally. As a 
result, a user-friendly surgical console and an efficient surgical tool are con- 
structed (Nawrat, 2011, 2012). 

The folowing medical robots have been prepared so far (Fig. 1): 

(1) Spherical model (2001); 
(2) Robin Heart 0 (2002); 
(3) Robin Heart 1 (2003); 





Fig. 1 The Robin Heart family of robots (from —_ and top): Robin Heart 0, Robin Heart 
Vision, Robin Heart Spheric + Robin Heart 0, Robin Heart Junior, Robin Heart Pelikan, 
Robin Heart PVA, Robin Heart 1, Robin Heart 8, Robin Heart Tele + Console Robin 
Stiff-Flop, Robin Heart Tele tool platform, Robin Heart mc2, Robin Heart mc? during 
in vivo test. 
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(4) Robin Heart 2 (2003); 

(5) Robin Heart Vision (2008); 

(6) Robin Heart Junior (2009); 

(7) Robin Heart mc’ and mechatronic tools Robin Heart Uni 

System (2009); 

(8) Robin Heart PortVisionAble model 0,1,2,3 (2012-2015); 

(9) Robin Heart Pelikan (2013); 
(10) TeleRobin (2015); and 
(11) Robin 8 (2016). 
The Robin Heart 0 and Robin Heart 1 telemanipulators have an indepen- 
dent base and are controlled via industrial computer and specialist software. 
The Robin Heart 2 is fixed to the operating table and has two arms, on 
which one can fix various surgical instruments. The control system uses 
its own software as well as signal and specialist microprocessors. The Robin 
Heart PortVisionAble (PVA) will become the surgeon’s partner in the oper- 
ating room next year. It will replace a human assistant who usually holds the 
endoscope to enable the observation of the operative field of laparoscopic 
instruments. The portable Robin Heart PVA is easy to use and install. 

Robin Heart mc’ is the biggest robot—it can work for three surgeons at 
the operating table. The biggest invention here is a tool platform consisting 
of two surgical instruments and an endoscope mounted on the robot’s mid- 
dle arm. This idea solves the collision problem of the robot arms. This mod- 
ular robot can be set for various operations in a selected way. The Robin 
Heart Tele robot solution can be developed as an extension of the tool 
platform concept. This robot was created for the implementation of a 
telemanipulation test project at various distances and under different physical 
conditions. It offers a completely new design solution, kinematics, and a 
larger workspace. 

The Robin Heart family of robots is mainly spherical. Each movement 
maintains a fixed point of rotation for the surgical instrument (remote center 
of motion—RCM). The RCM mechanism is based on a parallelogram 
structure. They should be set in a proper manner to the patient’s body, 
so that the construction pivot point is located where the tool passes through 
the patient’s body surface. 

Robin Heart 8 is an exception here. It was developed as a robotic tester 
of robots and surgical instruments, simulating any contact with the tissue (tis- 
sue physics) and any assumed limitations of the working space. However, 
currently, due to its kinematic properties—full freedom of choice of the tra- 
jectory—it is considered as a robot potentially usable in ophthalmology. 
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The Polish surgery robot is an original design. Thanks to its modular 
structure, it can be adjusted for surgery of different types. The Robin Heart 
Shell console is equipped with an advisory system that makes it possible to 
obtain all patients’ diagnostic information during the operation, as well as 
elements of the operation planning on the screen. The virtual operating the- 
ater introduced in our laboratory allows surgeons to practice some elements 
of an operation and check the best placement of the ports in order to avoid 
internal collisions. Exhaustive 3D visualization means this system can be 
helpful in planning an operation on a given patient. New, semi-automatic 
tools are in the process of emerging—Robin Heart Uni System. 

Using virtual reality technology, an interactive model of a surgery room 
equipped with a Robin Heart system was created with the use of EON 
Professional software. This computer modeling method allows advance pro- 
cedure training and will be used as a low-cost training station for surgeons. 
The model allows understanding better the process of less invasive surgery 
treatment and robot behavior. The link between this type of modeling and a 
computer aided design (CAD) technique is using accurate CAD robot 
models in VR software together with a precise reflection of workspace 
geometry (Nawrat and KoZzlak, 2007). This approach gives a surgeon an easy 
and intuitive way to understand technical information and uses it to optimize 
and plan medical process. The presented model of an operating room in a 
virtual reality environment has been performed in FRK and successfully 
used since 2006. 

The process of developing the robot starts from the determination of the 
tools-tissue reaction (mechanical characteristic, the forces for specific oper- 
ations, and dynamic analysis of tool work) and person—a tool and then man- 
machine contact (kinematic analysis of surgeon motion). Robin Heart Shell 
console includes not only ergonomic handles with microjoysticks but also 
the advisory system and the possibility of a full visual and voice communi- 
cation with the operating theater. 

The Robin Heart manipulator has a very good and relatively large work- 
ing space, in which the surgeon can select a small subspace with very good 
isotropic kinematics, as presented by Podsedkowski (2003), and properties 
for manipulating of objects with good position accuracy. The system has been 
verified both functionally and technically. Standard technical evaluation 
allowed estimating the value of positioning resolution equal to 0.1 (mm). 
The milestones of the project were animal experiments, carried out in January 
2009 (Robin Heart model 1, 2, Vision) and May 2010 (Robin Heart mc’). 
The operations were performed on pigs at the Centre of Experimental 
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Medicine (CEM), the Silesian Medical University in Katowice. The 
Robin Heart system experiment carried out on pigs allowed us to verify 
many aspects of a very complex project and was the source of hints for future 
development. A preoperation planning stage included surgeon training on 
physical and virtual anatomy models with the use of real pig tissues 
(Nawrat, 2011, 2012). 

In the course of the animal experiment, the surgical task achieved in the 
abdominal space was cholecystectomy, and in the chest and heart, the repair 
of heart valves (with extracorporeal circulation) using the Robin Heart 
models 1, 2, and Vision. In the last phase of the experiment, the efficiency 
of the Robin Heart Uni System mechatronic tools was checked—they were 
mounted on the robot’s arm (and controlled from the console) or held in 
the surgeon’s hand (manual control). Elements of the operations in the 
abdomen and heart cavities were successfully performed (Fig. 2). Roboti- 
cally supported totally endoscopic coronary artery bypass surgery (TECAB) 
was not performed due to collision of robots during the mammary 
harvesting procedure. It was decided to build a new robot. After 9 months, 
in 2010, the first experiment was conducted, by means of a specially 
designed robot—Robin Heart mc*. The purpose of the experiments was 
achieved: the surgical team accepted new construction functionality 
(Nawrat, 2011, 2012). 

Robin Heart mc” creates completely new job opportunities for a sur- 
geon—both in the local area and globally. It can be assembled as an arm 
of the platform (a small robot with two endoscopic tools and endoscope 
for observation) or as telemanipulator working for three people—the main 
surgeon, assisting surgeon, and an assistant holding the endoscope (con- 
trolled from console by one operator). It is a really new solution for robot- 
ically assisted surgery. 





Fig. 2 Research. Robin Heart mc? in version for four tools plus endoscope and classic 
two tools plus endoscope. Robin Heart mc2—modular robot hardware allows optimal 
set up into the operation. The robot can work in a set of four tools plus endoscope, or as 
a standalone platform with two tools plus endoscope working in the local work area. 
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As conclusions from the experiment, users (surgeons) have expressed 
positive opinions on the ergonomics and possibilities of controlling the 
robotic arms by means of the Robin Heart Shell console. The opportunities 
of operating by means of the Robin Heart Uni System mechatronic tool 
are very promising, as it may be mounted on the robot’s arm or controlled 
manually (Nawrat, 2011). 

The first model of teleoperation was performed in December 2010 
between two cities—Zabrze (FRK) and Katowice (CEM)—successfully. 
Robin Heart system experiments allowed verifying robots before the phase 
of preparing serial production and clinical initiating (Nawrat, 2011, 2012). 

Our new robot, Robin Heart PortVisionAble (PVA), enables some parts 
of surgery to be performed in the “solo” mode, i.e., independently by a sin- 
gle surgeon, while the surgeon advisor or student participates at a distance. 
Robin PVA, a lightweight, portable, and inexpensive robot can replace 
one of the assistants for mini-invasive surgery and enable the distance- 
participation of either experts/advisor or student during surgery. Three 
prototype robots ready for clinical trials have been prepared and tested. 
Developed research and technological documentation was used to start 
the series production and clinical implementation of this robot (Lis et al., 
2015). In 2019, this robot was sold to the Polish company Meden-Inmed, 
which is preparing its industrial implementation. 


3.1 Robin Heart innovation 


The Robin Heart system includes a planning system, training system, 
experts’ program, and advisory system, as well as telemanipulators and auto- 
matic surgical tools. In the Polish Robin Heart surgical robot, many original 
solutions were introduced (PL 208 988, PL 208 430, PL 208 432, PL 208 
433, PL 208 693, PL 217 349, PL. 220015, PL. 220329, PL. 409735, PL 
422691 EP3097839, US 9610135, EP 2990005B1, US 9393688, EP 3 
150 184B1, EP3146930, EP 15179357.7, EP 2949967A1, US2015/ 
034560, e-00090358-D (RCD), W-123845, W-123846, W-124541): tele- 
scopic sliding motion to move the tool (2002), mechatronic tool “for the 
hand (2006) and the robot”, and Robin Heart me (2010) is the first surgical 
robot that can work for three persons (two surgeons and assistant responsible 
for endoscope orientation) (Nawrat, 2011). Robin Heart PortVisionAble 
(2012-2016) and Pelikan (2013) are examples of robots for endoscope 
assistance. The Tele Robin Heart (2015) with a new multitool platform 
(modular type) is an example of development and progress in construction 
of new robots. 
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Heart surgery is still a challenge for robotics. Thanks to introduced inno- 
vations, such as modularity of structures, effective force feedback, or 
mechatronic tools, one can expect an increase in interest in surgical robots 
in areas where currently used robots do not meet the expectations of recip- 
ients, such as cardiac surgery. Safety and precision depend on the introduc- 
tion of a new quality of sensitivity and comfort of robot control. 


3.2 Construction—Modularity of structures 


In the Robin Heart mc* model, a technical solution in the form of a tool 
platform (two tools and an endoscope) placed on one arm was introduced, 
and then improved in the TeleRobin model (Figs. 2—4). “The aim of the 
invention is to provide a universal tool arms assembly of a surgical robot 
equipped with surgical instruments and fixing elements for a single support 
arm of any surgical robot, which should first of all eliminate low function- 
ality of surgical robot’s single support arm usually equipped only one surgical 
instrument, and furthermore eliminate problems resulting from limited 
work area and the possibility of collision occurring when surgical robots 
with multi-instrument arm assemblies are used. Another aim of the inven- 
tion is to provide an extended range of work of each of the tool arms ... and 
reduce the space and weight of surgical robot” (Nawrat et al., 2018a). 





Fig. 3 Robin Heart mc?—modular robot hardware allows optimal set up into the oper- 
ation. The robot can work in a set of four tools plus endoscope, or as a standalone plat- 
form with two tools plus endoscope working in the local work area. Animal tests using 
new Robin Heart robot mc” (mammary artery harvesting and bypass surgery) were 
carried out. 
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Fig. 4 Robin Heart mc? and TeleRobin—the new version of tools platform on one 
robotic arm. 


3.3 New tools 
A. For manual and robotic manipulations 
The opportunities of operating by means of the Robin Heart Uni 
System, a universal mechatronic tool for both; robotic arm and hand 
(it may be mounted on the robot’s arm and controlled by console or con- 
trolled manually), are very promising (Fig. 5). 





Fig. 5 At the top is shown a mechatronic tool with monitored reaction force with tis- 
sues. Research. Robin Heart Uni System. Animal test and new version of holder (2009). 
The universal system—a tool mounted on the robot arm can be used manually. Robin 
Heart Uni System v.1 and tools for classical and automatic sew. 
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Fig. 6 A model of innovative robot tools—Robin Heart with variable geometry (STIFF- 
FLOP project EU). 


B. For control of shape and physical parameters (flexibility, 
stiffness) 

Surgery needs new tools with controlled geometry and stiffness that 
can work effectively among soft tissues, limiting the destruction of 
healthy tissues during penetration and reaching the place of surgical 
intervention (Fig. 6) This concept of the robot was developed as part 
of the EU STIFF-FLOP project, of which the FRK was a participant 
(Arezzo et al., 2017). 


3.4 Control system 


The Robin Heart is a telemanipulator. Surgical telemanipulators work as a 
master-slave manipulator system. The basic task of the control module, the 
system working in this configuration, is to map the movements—the sur- 
geon’s hands (position/velocity adjuster and possibly other physical quanti- 
ties)—on the movement of the actuating arm by developing appropriate 
control signals for its drives. An additional feature of the system, which is 
highly sought by potential system users (surgeons), is the incorporation of 
a feedback system for transmitting the sensation of sensing the force/touch 
of the tool to the operator. To obtain the highest accuracy of movement it is 
necessary to have information about the state of tension of individual muscle 
groups, the speed of movements, and the angular position in the joints. It 
means that a good interface should offer a balanced resistance. 

To control robot motion, an appropriate information structure is 
required, understood as the transmission of a series of ordered data in time, 
containing a fixed amount of motion information and conditions for its 
implementation. Based on the analysis of the speed of information flow from 
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the receptor to the effector, it can be said that ballistic movements are con- 
trolled by ante factum. In contrast, in continuous movements, control takes 
place on an in-real-world basis. Muscle stimulation requires constant adjust- 
ment (differential values) to the existing situation so that it is possible to per- 
form a motor task (Nawrat, 2011). 


3.4.1 Force feedback 

In order to improve the safety of the endoscopic intervention, the surgeon 
must get on-line information about the physical parameters during the 
operation. The principal parameter required is the force as measured dur- 
ing interaction endoscopic tools with the tissue. The sensor built inside 
the gripper can measure the strength with which the laparoscope holds 
the surgical tool. The sensor placed on the tip can provide information 
about the hardness and surface roughness of the tissue the endoscopic tools 
touches. 

The present task activity is focused on integrating a tip head 3D tactile 
sensor and an array of force sensors, on the grasper head and inside the 
grasper, respectively. The first sensor facilitates steering and identification 
of the tissue the laparoscope touches, whereas the inside sensors provide 
appropriate information about the force with which the grasper holds a nee- 
dle, surgical sutures, or tissue. The feasibility of application in a laparoscope 
arm has been demonstrated in the frame of the “INCITE” project (2012— 
2017) by integrating two piezoresistive force sensors in a magnified grasper 
(Fig. 7). Three different functions are targeted: (1) microjoystick actuator to 
be integrated in the hilt of the endoscopic tool to provide easy robotic 
movement control during operation; (2) force sensor inside the endoscopic 
jaw to provide feedback to the surgeon by measuring the grasping strength; 
and (3) 3D force/tactile sensor, which facilitates palpation for tissue diagnos- 
tics during operation. A model of the robot controller using a prototype 3D 
sensor force has been successfully tested during the study of functional robot. 
The studies of prototype sensors have demonstrated their usefulness in the 
robot force feedback system to assess the state of tissue and to assess the 
clamping force of the grasper surgical system (Nawrat et al., 2016). 

The endoscopic tool was fixed on the arm of the Robin Heart surgery 
robot. The signals of both sensors were utilized to control the movement of 
the arm and the jaw of the gripper. In ongoing follow-up research, the group 
of FRK will elaborate adequate methodologies for human-robot 
interactions. 
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Sensor 


Fig. 7 Innovative sensors and their use in Robin Heart robot tool. “A surgical gripper 
with embedded force and tactile sensors and readout electronic circuit was developed. 
Piezoresistive, vectorial forces sensors were designed by ... according to the proposed 
force ranges and manufactured by 3D bulk micromachining technology. Two different 
MEMS sensors were electromechanically integrated into a metal endoscope tweezers 
together with the pre-processing electronics performing the analogues-digital data 
conversion and the communication towards the robot control system. According to 
the proposed medical application and functional requirements the sensors were 
embedded in biocompatible elastic polymer. The accomplished smart laparoscope 
was integrated with the Robin Heart surgery robot. The functionality of sensor system 
was validated by biomechanical tests” (Rado et al., 2018). 


One of the next Polish inventions is the Robin Heart Uni System. with 
force feedback information monitor. The Robin Heart Team plans include 
implementing clinically innovative mechatronic tools with force feedback. 


3.4.2 User interfaces 

The Robin Heart Team (FRK) tested the control of surgical robots using 
gestures, voice, remote control, and a set of haptic models. A completely 
new, ergonomic solution to this problem—motion haptic system Robin 
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Fig. 8 Robin Heart Tele and RobinHand user interfaces (Mucha et al., 2015). 


Hand (haptic system)—has been developed, presented in Fig. 8. The oper- 
ators must feel as if they were performing remote control tasks directly in the 
right environment, and moving freely in the free space, feeling contact with 
the obstacles encountered. 

The Robin Heart project introduces the idea of control, in which the 
operator intuitively determines the position of the working tip, and the 
operation itself (the developed concept of task automation) is activated by 
means of electronic buttons and microjoysticks (with the logic of control 
prepared for various tools). This concept allowed the natural introduction 
of a universal tool system (Mucha et al., 2015, 2018a,b). 


3.4.3 Robotic safety system 

According to Kirkpatrick’s summary, robotic surgery is generally safe with 
low overall complication rates, but adding a robot to the surgical equation 
inserts another potential entry point for error into an already complex and 
risk-fraught arena. In general, surgical outcomes are ultimately a direct man- 
ifestation of the skill and experience of the surgeon, not the technology or 
approach used. Potential areas for improvement and reduction of error 
in robotic surgery include more standardized training and credentialing 
practices, improved reporting systems for robotic-associated adverse events, 
and enhanced patient education (Kirkpatrick and LaGrange, 2016). 

The Robin Heart telemanipulator safety system includes a collection of 
mechanical solutions, an electronic drive system, and software. A significant 
part of the time and computing power of the telemanipulator system control 
system is intended for related tasks with support for system security modules. 
The basic elements of the safety system include: monitoring the operation of 
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the drive units (detection of current overloads and detection of exceeding 
the extreme limits, possible shutdown of the entire system, and unblocking 
of drive units for manual handling of the arms) and duplicate detection sen- 
sors (accelerometers, gyroscopes or rotary-pulse absolute position trans- 
ducers) of the actual shift at individual degrees of freedom connected by a 
fast serial peripheral interface bus. 


3.4.4 Robotics and remote action 

After the successes and development of many medical applications related to 
distance information technology, i.e., telemedicine, it is now possible to use 
technologies for remote transfer, i.e., medical telerobotics. 

One of the most interesting fields of development, for many reasons, is 
tele-surgery. First of all, we have to achieve the possibility of professional 
surgical intervention when and where it is necessary. But—which is often 
forgotten—in many cases, also the safety of medical personnel during sur- 
gery can and must be increased by moving the medical team away from 
the patient. The biggest technical problem is the delay in image transmission, 
which may prevent proper control of the robot’s operation. During the 
December conference “Medical Robots 2010” the first teleoperation exper- 
iment in Poland was carried out. The surgeon (Joanna Sliwka, a cardiac sur- 
geon at the Silesian Center for Heart Diseases in Zabrze) from behind a 
console in the FRK in Zabrze operated a Robin Heart robot placed in 
the Center for Experimental Medicine of the Medical University of Silesia 
in Katowice-Ligota (see Fig. 9). In the same operating room a few months 
earlier, an experiment was carried out on a pig using the Robin Heart mc* 
robot (Nawrat, 2011). 

Asa part of cooperation with the FRK, Emitel company set up a distance 
information transmission system consisting of a wireless point-to-point radio 
link (13km), data transmission system, audio-video signal from several 
sources along with conversion of analogue signal to digital. Measurement 
of the delay of the control signal between Katowice CEM and FRK in Zab- 
rze robot (1 ms) and image (280 ms) indicates that gallbladder excision can be 
performed today. However, the delay in image transmission, on the basis of 
which the surgeon operates, is too large to perform heart surgery. The Zab- 
rze team performed rail tests using an internet network, including robot 
control, at the Guido mine in 2016 (Fig. 9). Procedures for selected oper- 
ations and security systems during teleoperation are being developed. 
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2010 2016 
Fig. 9 RobinHeart Team (FRK) has pioneered research in Poland in the field of 
teleoperation. In the photo on the left, the Zabrz-Katowice teleoperation model from 
FRK to the Center for Experimental Medicine of the Medical University of Silesia in Kato- 
wice; on the right, a remote control experiment of the Robin Heart Pelikan robot at the 
Guido Mine in Zabrze. 


The first teleoperation with the da Vinci robot prototype (developed at 
the SRI in Stanford) by Richard Satava and John Bowersox (Bowersox 
et al., 1996) was done in 1996. The first spectacular success of tele-surgery 
was the Lindbergh Operation in September 2001, in which the signals con- 
trolling the robot were transmitted to a distance of 7000km, from New 
York to the hospital in Strasbourg (France). Jacques Marescaux, with his 
team IRCAD, using a Zeus robot, removed the gallbladder of a 68-year- 
old patient. It was the first RARTS (robot-assisted remote telepresence sur- 
gery) operation. The delay of the ATM OC-3 undersea fiber network with a 
10-Mb/s bandwidth transferring signals did not exceed 155 ms (for security 
reasons, the delay may not exceed 200 ms) (Marescaux and Rubino, 2004). 

M. Anvari introduced the first practical implementation of teleoperation 
for routine medical care in Canada (Anvari et al., 2005). Technological pro- 
gress concerning both the improvement of robots (operating tools) and 
devices for transmission, which will reduce the delay time of signals, will 
allow achieving proper system performance and its dissemination (Anvari, 
2007). The most important factor influencing the progress in the field of 
teleoperation is to reduce the delay in signal transmission related to the dis- 
tance between the operator and the robot, doctor, and patient. The intro- 
duction of the 5G standard is one of these opportunities. The first proof of 
this thesis is reports about an animal experiment carried out in China. “The 
operation was performed from a distance of 30 miles using a 5G connection 
with a latency of just 100 milliseconds” (Humphries, 2019). 


Robin Heart surgical robot: Description and future challenges 95 





3.5 Surgery planning 


The introduction of standardization for surgery requires planning and super- 
vising the implementation of the procedure. Depending on the choice of the 
tool (with different degrees of freedom and geometry), we can operate it in a 
different space (workspace). Therefore, it is very important to optimize the 
process; for example, the selection of the right places for making openings in 
the patient’s body shells—Fig. 10. The Robin Heart Team used virtual space 
technology and created a virtual operating room for planning and training of 
robot operations. In addition, computer simulations of biophysical effects 
are performed, which are used in the advisory program for the Robin Heart 
robot operator. 

The model allows for a better understanding process of less invasive sur- 
gery treatment and robot behavior. The link between this type of modeling 
and computer aided design (CAD) techniques is using accurate CAD robot 
models in VR software together with a precise reflection of workspace 
geometry (Nawrat and KoZzlak, 2007). This approach gives a surgeon an easy 
and intuitive way to understand technical information and use it to optimize 
and plan medical process. The presented model of an operating room in a 
VR environment has been performed in FRK and successfully used 
since 2006. 

The surgeon’s training system includes both a virtual computer operating 
room and hybrid systems connecting the physical console with the virtual 
system. The advisory system includes an operation planning system and 
computer simulations of the effects of the operation (for example; pressure 
and flow in blood vessels after a by-pass operation). 


3.6 Surgery training 


Work prepared by Matota et al. presents the latest FRK experience in the 
technical support of surgical training methods. There are a variety of simu- 
lators: synthetic models and box trainers, live animal models, cadaveric 
models, ex vivo animal tissue models, virtual reality (computer-based) 
models, hybrid simulators, procedure-specific trainers, and robotic simula- 
tors (Fig. 11). The most important factor for obtaining an appropriate sur- 
gical simulation is creating quasi-natural geometry of surgical scene and 
physical characteristics of the used materials. Constructing simulators for a 
completely new type of tool is a challenge for both engineers researching 
devices for new tools as well as trainers (surgeons) to discover the optimal 
use of new functional features of tools for various types of operations. 
The fidelity of a simulator is determined by the extent to which it provides 
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Fig. 10 Virtual operating room, physical model for surgical tests and studying the work 
space of the surgical Robin Heart 1 robot and Robin Heart PVA during endoscopic 
surgery (ergonomy study). 


Robin Heart surgical robot: Description and future challenges 97 








Fig. 11 The figures illustrate prepared in FRK training and testing systems: endoscopic 
tools training system, and two robotic testing system (mechatronic tissue simulation). 


realism through characteristics such as visual cues, tactile features, feedback 
capabilities, and interaction with the trainee. 

The modeling of biological tissues is very difficult because the biological 
soft tissues have nonlinear force-deformation properties and show viscous 
behavior. Additionally, dissected tissue changes its mechanical properties 
and all properties strongly depend on many factors, including temperature, 
pressure and patient health (pathology). The artificial surgical scene and 
described devices for testing tools and surgeons create the possibility of stan- 
dardization for the educational and research process. The new solution is 
to test robots using robotic devices that simulate tool behavior in various 
clinical situations. All these experiences constitute a unique support for 
constructors and users of mechatronic and robotic tools created in the 
FRK (Matota et al., 2018). 

An especially interesting solution is the test robot Robin 8 (Nawrat et al., 
2018b), shown in Fig. 11 on the right. It allows testing of surgical instru- 
ments and surgical robots by simulating the loads and range of motion suit- 
able for various tasks performed in the patient’s body. A computer, to which 
an appropriate model of physical properties of tissue and ambient geometry 
are introduced, controls the system. 





4 Future directions for the Robin Heart project 
4.1 Flex tools and STIFF-FLOP 


Surgery needs new tools with controlled geometry and stiffness that can 
work effectively among soft tissues, limiting the destruction of healthy 
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Fig. 12 The project of flexible tool supported in part by the European Commission 
within the STIFF-FLOP FP7 European project FP7/ICT-2011-7-287728 presentation at 
King’s College London. 


tissues during penetration and reaching the place of surgical intervention. 
This concept of the robot was developed as a part of the EU STIFF-FLOP 
project, of which the FRK was a participant (Fig. 12). The project ended 
with a robot demonstration made on cadaver (Arezzo et al., 2017). 

In various publications (Mucha et al., 2015, 2018a,b), the FRK haptic 
system has been presented. “Designing a surgical robot operator’s work- 
station requires an in-depth analysis of the specificity of a surgeon’s work; 
experience, psychology (related to the decision making processes and fac- 
tors that have an impact on the precision of work), ergonomics, anatomy, 
physiology, tissue biophysics and the robot itself (kinematic structure, 
robot control system characteristics). It has been assumed for Robin Heart 
robots that actuating the position of the tool tip will be performed intui- 
tively and the robot’s operator will acquire a complete set of information: 
visual and haptic feedback, which will enable accurate control of the new- 
type robot. The challenge of the Stiff Flop project (the pneumatically con- 
trolled soft robot) was in the need to control the tool tip mounted on an 
arm with a variable, controllable stiffness and geometry. A set of sensors on 
the surface of the octopus-inspired arm tool give access to information 
about an interaction with organs, which are transmitted to a special sleeve 
on the surgeon’s arm. Guided by data from visual monitors, the operator 
moves and actuates certain tool actions. FRK team have developed a 
specially equipped console — an ergonomic surgeon’s workstation” 
(Mucha et al., 2018b). 
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Fig. 13 Robin Stiff-Flop Console: CAD model and real console with Robin Heart Tele 
robot. 





Fig. 14 The full haptic system: flexible manipulator plus vibration sleeve test of 
feedback. 


The system was launched and tested with force feedback acting both 
on the haptic console and the vibrating sleeve. The integrated system 
(Figs. 13 and 14) used for the testing comprised of: 

* two pneumatically operated robot arms equipped with both a lateral 
flexi force sensor as well as frontal and circular lateral pressure 
sensors; and 

* a completely integrated system composed of the FRK Robin Hand 
haptic, a haptic vibration sleeve and a soft robot arm (made from 
Dacron—Polyester Fiber vessel prosthesis and Ecoflex—30 silicone). 

Encoders in the haptic Robin Hand unit capture the movement performed 

by the operator’s hand. Information from the encoder is processed by a 

microcontroller and is sent in the form of Cartesian coordinates to the 

microcontroller, which operates the pressure valves used to control the 
robot arm’s movements. 
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4.2 AORobAS project 


Potential applications of robotics in cardiac surgery include: aortic valve 
replacement (standard or percutaneous technology); tricuspid valve repair; 
descending thoracic aortic surgery; transmyocardial laser revascularization; 
ventricular septal defect, patent ductus arteriosus, coarctation; intramyo- 
cardial delivery platform for biological agents such as stem cells, molecular 
therapeutics, genetic vectors; and AORobAS—artificial organs robotically 
assisted surgery. There are plans to use the robot for implanting artificial 
organs, prostheses, and ventricular assist devices. 

The future plans connected with development of the Polish robot 
Robin Heart include carrying out a robotically assisted minimally invasive 
surgery to implant artificial organs; VADs, TAHs, valve, vessel prostheses. 
Currently, clinically used blood pumps, valves, and pace makers require 
to be replaced and repaired during the patient’s life. This is a temporary 
application. The best for a patient will be realization of conception of 
mini-invasive service of artificial organs. Robots are ideal for this task 
(Nawrat, 2001). 


4.3 Hybrid surgery robots 


The author proposed a novel system for hybrid operations (Fig. 15), in 
which a cardiologist and cardiac surgeon can jointly perform a heart surgery, 
in 2017. The system consists of two robots that offer vascular and surgical 
access to the heart, two control consoles, and an appropriate information 
system, creating a synergy of information exchange and interoperability. 
The idea will be implemented after obtaining financing. The developed 
system is a challenge for the ergonomics of control. 


4.4 Robin Heart Synergy 


The aim of the Robin Heart Synergy project is to improve the functionality, 
safety, ergonomic, and economic aspects of using a surgical robot. The most 
important task of the project will be to solve the problem of assembling the 
robot with the operating table by integrating the robot’s position control 
with the current position of the operating table. 

Robin Heart Synergy is a modular telemanipulator equipped with a uni- 
versal system of mechatronic surgical tools, synchronized with the operating 
table. The main objective of the project is to study the possibilities of devel- 
oping the concept of a surgical robot as a device cooperating both with ele- 
ments of the operating room and with all members of the operating team. 
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Fig. 15 Schematic representation of the idea of a hybrid robot (SurgRobin + CathRobin) 
and Robin Heart Cardio robot model (for invasive cardiology). 


The synergy action will be achieved by introducing innovative solutions to 
technological, structural, and organizational processes of surgery. It will aim 
to achieve shorter operating time, greater comfort and safety, and the oppor- 
tunity to develop teleoperation. Unfortunately, the project, announced in 
2014, has not been financed to date. 


4.5 Robin Heart Pelikan and lightweight robots technology 


The Lis work presents a new, light Robin Heart robot. “To meet the expec- 
tations of veterinary physicians, a team of researchers from the Cardiac Sur- 
gery Development Foundation and the Silesian University of Technology 
decided to assess the applicability of the Robin Heart “Pelikan” robot in vet- 
erinary procedures performed on animals. For the purpose of the project, a 
special support frame was made to mount the robot on a standard operating 
table and to pre-position it conveniently for the patient and the operating 
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Fig. 16 The Robin Heart “Pelikan” is a vision tracking robot that has 4 degrees of free- 
dom (DOF 4) enabling it to navigate the camera inside the abdominal animal cavity. 


surgeon. The Robin Heart “Pelikan” is a vision-tracking robot that has 
4 degrees of freedom (DOF 4) enabling it to navigate the camera inside 
the abdominal cavity. DOF 1 and 2 make it possible to change the position 
of the robot (tilting front-back and left-right), while DOF 3 and 4 are 
responsible for rotating the camera and for pulling it forward and backward” 
(Lis et al., 2017). 

This robot has a mechanical constant fixed position at the camera’s 
entrance port on the patient’s skin (remote center of motion; RCM). Com- 
posite materials made it possible to minimize the weight of the robot (which 
is approx. 4kg), permitting transportation in a small suitcase. Steering the 
robot is done with a manipulator mounted directly on a traditional laparo- 
scopic tool. The surgeon uses the index finger to exert pressure on a force 
sensor. This solution makes it possible to manipulate the robot freely with- 
out putting away the tools held in the hand. Fig. 16 shows the robot’s 
degrees of freedom, the mounting system (the supporting frame) adjustment, 
and the steering system options (direction controller). 





5 Discussion “challenges and limitations” 


The current state of development of artificial intelligence and sensory 
devices is insufficient, so currently used surgical robots are telemanipulators. 
Designing a robotic tool is a challenge for a multidisciplinary team in which 
ergonomics is as important to success as precision and operational safety. 
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5.1 Decision-making and artificial intelligence 


High hopes are connected with the influence of artificial intelligence on the 

development of medicine. In my opinion, artificial intelligence is a robotics 

department. The source of the word robot is associated with the figure of 

an artificial man introduced by Karel Capek in the science fiction play. R. 

U.R.—Rossumovi Univerzalni Roboti (Rossum’s Universal Robots), in 

1920. Asis well known, rational man (Homo sapiens) is the only contemporary 

species of the Homo genus. This means that reason and intelligence played a 

decisive role in human survival. If we want robots to replace human beings, 

they must be available in a quality (standard) similar to that ofa human being. 

Robotics is a technical discipline that deals with mechanisms, executive 
assemblies, and computers. Because humans have brains, artificial intelli- 
gence is an integral part of robotics. Simplifying: the robot is a smart com- 
bination of sensory and executive devices. 

Intelligence is the ability to perceive, analyze, and adapt to changes in the 
environment. Intelligence is an ability to understand, learn and use your 
knowledge and skills in different situations (appropriate reacting and solving 
problems); according to L.L. Thurstone: verbal fluency, numerical abilities, 
spatial abilities, reasoning, memory, and speed of perception (Thurstone, 
1938). Therefore, the key to introducing intelligence to robotics is to 
acquire information (sensors, speech, and image recognition) and its skillful 
use for action, that is, proper response to external stimuli, communication, 
and language, etc. Essentially, artificial intelligence was created to commu- 
nicate machines and computers with human intelligence. 

The space in which we live is a space of information (in a given point in 
time and space we can assign information, data, history), space: 

— geometric (we can determine, or measure, positions x, y, z in the Cartesian 
system of each point); and 

— physical (we can determine, or measure, the physical values of an electro- 
magnetic field, etc.). 

For the physician, the area of surgery is also a space: 

— biological (we can determine, i.e., diagnose and describe, physiological 
and pathological traits—related to the development of the disease—the 
organism, organs, tissues, cells, etc.). 

For the patient, doctor, and administrator, important role plays also space: 

— economic (in which each activity is assigned a value of financial burden); 

—legal/ethical (in which rights and threats are defined for each 
decision); and 
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— statistical (evaluation of chances and threats for the treatment strategy 
being pursued). 

Returning to intelligence—this is our device to optimize the decisions we 

make in this multidimensional information space. 

Man is information — about 1 Tb during the year. Sick man (for instance 
who suffers from diabetes or heart) collects even more, very important infor- 
mation. Data analysis, the so-called big data, shows spectacular successes (and 
failures) by analyzing the impact of drugs, diet, or behavior on the effective- 
ness of treatment. Where the scope of cause-and-effect analysis, application 
and verification of theory, and strict algorithms ends, a field for the use of 
multilayer computer neural networks, self-learning, and artificial intelli- 
gence applications appears. 

Social work and service robots require cooperation with humans, so for 
them, artificial intelligence is a measure of the success of communication with 
a human being. But for surgical robots, a human appears in the form ofa com- 
plex biological work space, tissues, proteins, genes, and physiology, reacting 
to a specific situation requiring the surgeon’s knowledge or ability to assess 
what the effects will be of, for example, incisions in a specific manner or 
removal of a specific body part (e.g., in the case of oncological diseases). 

A human is just as good as his or her senses and the ability to use infor- 
mation (reason, experience). The robot is only as good as its ability to use 
information. Since we still do not have possibilities to use artificial intelli- 
gence in all seven features (following L.L. Thurstone), therefore, today sur- 
gical robots are only telemanipulators controlled by surgeons (we expect 
that they have all intelligence features, which are obviously verified during 
medical career stages). 


5.2 How the surgeon’s decision is made 


Let’s try to analyze the decision making process by the operator from the point 
of view of artificial intelligence methods used in process automation. Decision- 
making situations can be divided into determined (making decisions under 
conditions of certainty), random (in risk conditions), and conflict (in conflict 
conditions, game theory). In the decision-making process, the following phases 
can be distinguished: recognition (collection of information), modeling (con- 
struction ofa decision-making model), and deciding (selection of the best deci- 
sion). The implementation of the objective requires the use of available 
resources (material, financial, time, human, etc.) in the form of a strategy. 
The surgeon often makes decisions in conditions of external uncertainty 
(lack of sufficient knowledge about the operating environment) and internal 
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(lack of knowledge and experience). Using advisory and training systems can 
reduce the area of uncertainty. 

In situations of uncertainty, the decision-making procedure may be 
heuristic (open) or algorithmic (closed). Unlike an algorithm that provides 
a detailed description of steps, the heuristics provide useful hints. In situa- 
tions without a clearly defined pattern of conduct and in unspecified 
conditions of the work environment, decisions should be of a creative 
nature. Computerized advisory systems and controlled, programmed navi- 
gation reduces the occurrence of a surgical error (through the analysis of 
diagnostic information and current real assessments of the operation field, 
the algorithm is introduced). 

Erroneous decisions are based on the illusions of correlation and deter- 
mination, as well as maintaining the first assessments and consequences. It 
should be noted that during a teleoperation the surgeon is away from 
the patient, but also from his or her team. The decisions made, especially 
in the situation of a threat, are influenced by many features, e.g., behavior, 
sensations, gestures of team members, temperature, smell. On the other 
hand, the possibility of moving away the elements disrupting the surgeon’s 
work can play a positive role for the results (time and effect of the operation). 
However, to use the unique possibility of focusing only on the operated 
object, balanced movements, and the implementation of tasks, it is necessary 
to provide and adequately present the information necessary to conduct— 
including those that appear during the procedure outside the observation 
field. 

Human decision-making is based on one of the two thought patterns: 
Cartesian (cause-and-effect thinking based on classic logic, thinking pre- 
cedes action: “I think, I decide”) or Darwinian (trial and error method, 
action precedes decisions: “I check effect of the decision made”). When 
it is possible (for example for neurosurgical operation), due to the predictable 
behavior and geometry of the object, based on diagnostics, the plan of the 
trajectory and tasks of the tool is made. After determining the spatial fit of the 
robot relative to the patient’s body, tasks can be performed automatically to a 
large extent. 

The Robin Heart project assumes the use of complete motion sequences 
encoded in the processor and actuated with microjoysticks, corresponding 
to functionalities such as sewing or tissue separation. 

Surgical telemanipulators use both standards. The role of individual 
experience and the features associated with the selection of appropriate deci- 
sions 1s evidenced by the fact that in all statistical reports on the use of various 
surgical techniques, the most reliable ones are those referring to who (or 
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what center) performed the operation. Similar relationships are observed in 
other team activities in which the role ofa leader plays a decisive role. Thus, 
the surgeon’s work bears not only the features of executive perfection 
(craftsman), but to a large extent, also managerial (conductor, trainer). 

Weare currently observing rapid progress in the development of artificial 
intelligence that will lead to the independence of robots. The surgeon- 
operator, however, will control surgical robots while there is no proper sen- 
sor. People make decisions based on information obtained through the 
senses and based on their own experience (learning process). There are cur- 
rently no force sensors on the market with the appropriate sensitivity and 
strength to be mounted in surgical instruments. However, the door for 
the introduction of automation and AI is already opening: in March 
2018, Corindus Vascular received 510 (k) clearance from the U.S. Food 
and Drug Administration (FDA) for the first automated robotic movement 
designed for its CorPath GRX platform. Called “Rotate on Retract” 
(RoR), the proprietary software feature is the first automated robotic move- 
ment in the technIQ Series for the CorPath GRX platform. It allows the 
operator to navigate quickly to a targeted lesion by automatically rotating 
the guidewire upon joystick retraction (Corindus, 2018). 


5.3 Ergonomics 


Ergonomics introduces a human factor to the design of machines, buildings, 

and objects in the human environment. It can be argued that, due to diffi- 

culties in optimizing the ergonomic work of the surgeon, only medical 

robots allow the introduction of all aspects of the surgeon’s ergonomic 

workplace. In 1916, Frank Gilbreth, a pioneer in the field of time and 

motion study, stated that “...surgeons could learn more about motion study, 

time study, waste elimination, and scientific management from the indus- 

tries than the industries could learn from the hospitals” (Gilbreth, 1916). 
Efforts to create a more user-friendly operating room environment 

require the rethinking of traditional concepts of architecture, asepsis, and 

staffing. Berguer, in a review of ergonomics in surgery, divided the issue into 

the following categories: 

a. visualization; 

. manipulation; 

- posture; 

. mental and physical workload; and 


onan & 


. the operating room environment (Berguer, 1999). 
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The introduction of the possibility of long-distance surgery into the surgical 
practice will redefine the problem of locality (space, distance) and time (sig- 
nal delays). At present, there are ongoing processes to reconcile the legal 
aspects of risk and responsibility sharing. 

The creation of the Robin Heart Shell console project preceded the 
research of the method (kinematics, dynamics) of performing surgical oper- 
ations using various types of tools (force measurements and motion analysis, 
trajectory, recorded with the help of several cameras). The result of these 
tests is the optimization of the haptic devices described above and the work- 
stations (e.g., proper angles of setting monitors and access to all elements of 
the robot’s control system). Mechanical problems of ergonomics are obvi- 
ous; however, the issues of software ergonomics are worth special attention. 
Medical robots bring this completely new aspect to the responsibilities of a 
surgical equipment designer. 

Bernstein is regarded as one of the founders of the modern theory of 
movement behavior, who in his work on the Structure of Movements 
(1947) made its foundations. The beginning of the movement is, according 
to Bernstein, possible after imagining the goal and constructing the program 
of action. The introduction of a computer between the surgeon’s hand and 
the tool makes it possible to apply software limitations and improve the 
movement and tasks performed by the tools. Together with the operational 
planning system and advisory programs that can operate on line, it creates a 
system that limits risks, can be improved (AI), and can set standards for spe- 
cific procedures. One of the most difficult challenges is the optimization of 
the motion transfer system from the operator’s hand to the movement of 
the surgical tool (on-line orders for performed tasks) (Nawrat, 2011). 

Bidard reviewed and described the design work of the input device for 
tele-surgery (Bidard et al., 2005). In the work of Mucha (Mucha et al., 2015, 
2018a), the currently used user interfaces were reviewed, and the results of 
the Zabrze team’s work on the technical solutions for the transfer of haptic 
information to Robin Heart robots were summarized. 


5.4 Software ergonomics 


A surgical robot is now more a mechatronic tool than an IT (information 
technology) tool. However, the challenges of appropriate decision-making 
flexibility and precision (especially in the absence of professional staff in 
the conditions of demographic problems) indicate that the direction of 
development toward autonomous (partly or fully) medical robots is the most 
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up-to-date. The idea of spaceflight and establishing bases in distant objects 
from Earth and the need to secure medical service has also returned. 

The principles of ergonomics should be applied when creating soft- 
ware—ensuring the effectiveness, efficiency, and satisfaction of the 
employee. These three properties make up the software utility. Let us men- 
tion a few principles (called heuristics) of software ergonomics: feedback (for 
each activity there should be a reaction or system information); availability 
(providing tools and information according to the user’s needs); simple and 
natural dialogue; application of the user’s language (language of symbols 
from the user’s environment); reducing the load on short-term memory 
(no need to memorize a lot of information); confirmation of activities (infor- 
mation on the effect of activities); and elimination of errors. The software 
created as part of the Robin Heart project meets these principles. 

The issues discussed are the key to building the proper telemanipulator 
control system and software. Man, the operator of a surgical robot, can be 
treated as an element of the control system (we take into account both the 
processing of information in the brain and its dependent motor coordina- 
tion of precise control—motion control, position, speed, and strength— 
through the robot interfaces) connected by the system IT and operation 
of the robot electromechanical system with an executive tool. In terms 
of artificial organs—and so you can treat the robot (as a prosthesis, 
prolonging the surgeon’s hand)—1it is a hybrid organ (because it is neces- 
sary for proper operation to use cells, natural organs, simply human- 
operator) (Nawrat, 2011). 


5.5 How to improve the decision making system of the 
surgeon—tThe robot’s operator 

The surgeon, knowing the patient’s history (interview), documented diag- 
nostic data, knowledge and professional experience, risk and chances, or 
potential prognosis of changes and progression of the disease, selects the 
optimal treatment strategy for the patient, including specific surgical inter- 
ventions. However, when undertaking surgical procedures, it is usually nec- 
essary to modify the tactics by reacting (intelligence) to the existing image 
of the operation field and the emerging effects of introduced modifications 
of organs and tissues by means of surgical instruments, materials, devices, and 
implants. 

Considering all of the above-mentioned areas of knowledge and uncer- 
tainty, Robin Heart’s robotic development strategy assumes the introduc- 
tion of a standard based on: 
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= 


education (practical master-student type and theoretical type access to the 
knowledge base, clinical case database); 


1) 


planning (based on virtual space technologies such as our virtual 
operating room); 


i”) 


training (both on physical trainers containing the model of surgical scenes 
and animal tissue as well as virtual and computer); 
verification of progress (based on facts, i.e., measurable, objectified, traits 


‘a 


of practical skills); 

system of direct advising during on-line operation (based on facts: diag- 
nostic data and results of simulations of the effects of surgery—e.g., blood 
pressure and blood flow during the operation of the cardiovascular system 
such as by pass or replacement of the heart valve). 


wn 


From a practical point of view, however, the ergonomics of software and 
mechanical design as well as sensory information (operation field image 
and touch information) are of the greatest importance to the success of 
the telemanipulator implementation, convenience, and comfort of the 
workplace, i.e., user interfaces. For the surgeon, the most important in this 
regard is the haptic controller responsible for transferring decisions with the 
help of a hand with a specific motion and a task to perform for surgical 
instruments. 





6 Conclusion 


The success of robots in surgery depends on many factors: effective, 
precise mechatronic tools and an efficient, ergonomic control system. Lack 
of tactile information and force feedback impairs the surgeon’s efficiency 
during surgery and increases the risk of making a mistake. 

The Robin Heart family of Polish robots has a chance of becoming a 
commonly used telemedical system facilitating the performance of some 
parts of operations in minimally invasive, precise manner, safe for the patient 
and the surgeon (Nawrat et al., 2002; Nawrat and Kostka, 2006, 2008; 
Nawrat, 2008, 2011). 

The lack of force feedback is one of the main barriers in the progress 
and widespread application of robotic surgery. The main tasks of the sur- 
gical robot control are the mapping and analysis of the movements of the 
surgeon operator (position/velocity and possibly other physical parame- 
ters), and also facilitating arm movement by providing control signals to 
the actuators. Additionally, it is desirable to reverse transfer the force/touch 
information to the person handling the tools. These signals can help the 
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operator to make immediate correcting actions during the operation: cut- 
ting, separation, handle and move tissues, to care vascular clamping, to tie a 
knot, to recognize the type of tissue (pathology, calcification), to manip- 
ulate between different elements of internal organs without the risk of har- 
ming neighboring tissue, and also to sense collision of arms/or tools by 
automatic recognition. 

Currently used endoscopic and robotic surgical instruments are rigid and 
straightforward, so they have limited reach. The introduction of adjustable 
stiffness and geometry tools can have a fundamental impact on extending 
endoscopic surgery capabilities to many patients in need. 

A surgical robot is today an IT tool rather than a mechanical one. Man, 
the operator of a surgical robot, can be treated as an element of the control 
system connected by the IT system and operation of the robot electrome- 
chanical system with the executive tool (we take into account both the 
processing of information in the brain and its dependent motor coordination 
of precise control via robot interfaces). 

Surgical robots are a way to introduce standardization and reduce inva- 
siveness, while ensuring proper operation safety. Robots (cobots) interacting 
with people change the way of performing many professions. Robots create 
the possibility of standardization and constant improvement of quality 
through learning (AI) and communication with a professional information 
network (professional databases and management system) as well as with 
other medical devices (diagnostic, therapeutic, rehabilitation), and also 
elements of hospital infrastructure. 

Robots are created to multiply human freedom. They reduce our work- 
load, add strength, precision, efficiency, they bring back to society people 
who lost their freedom due to diseases and organ failures (artificial organs, 
exoskeletons). That is why it is really worth developing robotics. 
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1 Introduction 


Advancement of technologies has enabled robotics to enter into the 
domestic and social setting in addition to their existing industrial presence. 
However, unlike the organized environment of an industry, the operating 
area of a social robot is often unstructured. Real-time accurate visual feed- 
back is required for precisely identifying the object and to determine the best 
way to pick up the object. Identifying objects with respect to the task at hand 
from a random environment has always been a challenge for robotic manip- 
ulation. Once identified, the end effector has to efficiently handle the object 
to perform the required task. Industrial manipulators are often designed spe- 
cifically for a particular task, for example, a gripper to pick and place objects 
in a supply chain or a drilling platform to handle various machining tools. 
A generic anthropomorphic gripper which can do more than pick and place 
tasks will benefit social robots more, since their usage is increasing and 
extending into several application domains. In this chapter, a viable solution 
is presented for one such application. 

Initiated by IROS 2018 (IEEE/RSJ International Conference on Intel- 
ligent Robots and Systems) which was held at Madrid, Spain (October 1-5, 
2018), the fan robotic challenge task is to pick up a Spanish fan from a ran- 
dom position on the table, to open and close it, and to place it back on the 
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table. The solution presented in this chapter is the only one demonstrated in 
the conference, which operates in a way similar to a human hand. The whole 
setup is established on a PC platform with Python development environ- 
ment. The PyKinect2 API is used to acquire the visual data from Kinect 
v2 which consists of RGB camera, three-dimensional (3D) depth sensor, 
and multiarray mic. Object recognition from the background is done with 
the algorithm of color detection in thresholding from the output of RGB 
camera (resolution 1920 x 1080). Canny edge detection and noise reduc- 
tion are performed to improve the sensitivity of the results. A method of 
classifying the same color, different paced objects is recognized by analyzing 
the contour area and depth distance from IR camera (depth camera with 
resolution of 512 x 424). Center of mass is calculated from the image 
moments of the selected contour. Even though pixel coordinates have been 
mapped to a real-world coordinate system using linear relationship, real 
world to robotic coordinate system relationship is much complex. A data- 
base was used for the analysis to find the relationship between the relevant 
coordinate systems. 

A hybrid robotic gripper consisting of a rigid tendon-driven anthropo- 
morphic hand with flexible soft layer enhancements was used for handling 
the fan. The rigid framework is 3D printed using PLA and the soft layers are 
made of stretchable EcoFlex™ 00-30 material. The tendons are fixed to 
servo motors to actuate the movement of the fingers. Torque-based control 
is used to drive the tendons for adjusting the grab strength where as a faster 
position-based control is reserved for the initial grab and the final release 
operations. The fan is opened due to a combination of gravity and inertial 
forces. While closing the fan, the gripper rotates 90 degrees in a swift motion 
similar to the way a human hand would operate. A UR5 robotic arm is used 
to move the gripper to the initial position to pick up the fan, through the 
desired open-close trajectory and to return the fan back to the table. 

Overall, the performance of the completed task is about 98% in accuracy 
and the results are more robust than stereo images. Besides, the proposed 
methodology is less in cost comparing to other techniques with SURF, 
STICK; less in complexity with other software such as MATLAB; less in 
computational power than using neural networks. The remaining chapter 
is organized as follows. Section 2 summarizes related works which focus 
on similar object identification/classification tasks and a brief introduction 
on soft robotic grippers involved in manipulation tasks and tactile sensors. 
Section 3 describes the proposed object identification methodology in detail 
whereas Section 4 explains about the gripper used and the sequential steps 
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followed during the manipulation of the fan. The final section concludes 
with remarks and future research possibilities. 





2 Related work 
2.1 Vision perception 


Even though the visual perception system is task specific, we propose this 
method for robust and more general task-specific systems to increase its 
functionality. A similar concept has been used for the Amazon Picking Chal- 
lenge of several years (Zeng et al., 2017; Jonschkowski et al., 2016; Roshni 
and Kumar, 2017a). Research works have been done on this approach by 
running a convolutional neural network trained by a large amount of data. 
Prescanned 3D models were used to get the 6D object pose. Deep reinforce- 
ment learning algorithm with bioinspired structures was used to design self- 
sufficient agents that can learn from observations in its environment (Bhagat 
et al., 2019). An unsupervised machine learning algorithm can be developed 
to detect known objects (Barbosa et al., 2017). Currently, imitation learning 
algorithms are used instead of mathematical models due to countless degrees 
of freedom (DOF). Since the scope of this chapter is limited to one object, 
instead of training a network, one can detect the object from feature extrac- 
tion and color detection techniques. An intensity-based approach was used 
by Nadeau et al. (2015) to extract a moving object from the background. It 
was used for the 3D pose estimation task later in this chapter. This is not only 
limited to pick up the object but also for the opening of Spanish fan as to 
how human hand operates. 

Point Cloud library, an open source library for algorithms of 3D point 
cloud processing, has been used for implementing numerous techniques 
in various applications (Cousins and Rusu, 2011; Alcantara et al., 2018). 
If multiple objects with the same color are present in the background, 
CIE-Lab color space and depth images can be taken to neglect other objects 
and identify the object of interest (Hernandez-Lopez et al., 2012). Object 
detection is done using more than one active camera in a dynamic environ- 
ment (Celik et al., 2017). An object is detected based on the shape and a 
bounding box is created. Coordinates of the bounding box are used to cal- 
culate the centroid of the object and tracking is done with active motors via 
Arduino-MATLAB implementation. A quick object detection technique is 
used in autonomous vehicles or computer-assisted driving systems (Xitao 
and Zhang, 2010). Camera shot angle, camera focal length, and virtual 
square parameters are used in solving the coordination of an object from 
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two simultaneous images. It is performed within a minimum time in the vir- 
tual square which reduced the image size. Adaptive color thresholding 1s 
used for detection applications in robotics and embedded systems (Soans 
et al., 2017). Image pyramid technique is used to reduce the size of an image, 
following color separating, finding the edge of the image by Sobel and thin- 
ning and locating the center of the image using Hough Transform 
(Palungsuntikul and Premchaiswadi, 2010). 

Classification of features can be applied in binary style for object detec- 
tion as it will make the application faster comparing to traditional technique 
(Dornaika and Chakik, 2010; Nakashima and Yabuta, 2018; Chelva et al., 
2016). Binary support vector machine classifier is used to classify image fea- 
tures into object features and nonobject features. Features are extracted 
based on the continuous color model and discontinuous color model of 
image intensity patterns with adaptive color difference signals (Ukida 
et al., 2012). Pixel values can be calculated on canny edge detection or B 
edge detection in the matching process (Yadav and Singh, 2016; Mittal 
et al., 2019). Once the object is identified, its image moments can be used 
to calculate the center of mass of the selected contour (Balakrishnan and Jaya, 
2014; Roshni and Kumar, 2017b). In previous works, the largest area 
contour algorithm and depth segmentation techniques have been used to 
recognize an object from same colored multiple objects and to solve object 
pose uncertainty (Fan et al., 2018). 


2.2 Robotic gripper 


Grasping and manipulating an object has been one of the most common 
tasks to be done by a robot. Depending on the complexity of the task itself, 
it can be done with two grippers or just one. In this chapter, we use a single 
robotic gripper to grasp, open and close a fan as a human hand would do. 
Several research works have been conducted to investigate the dynamics 
and capabilities of multifingered robotic hands with tendon-driven systems. 
For example, Catalano et al. (2014) explored the design and control strate- 
gies for the Pisa/IIT soft hand, and Dollar and Backus (2016) described a 
three-fingered prismatic gripper with passive rotational joints. Tendon- 
driven designs involve in better flexibility and dexterity comparing to 
concentric tube designs (Li et al., 2017b). For real-time position and shape 
sensing in tendon-driven robots, an electromagnetic sensor placed at the 
distal end of the robot to obtain positional and directional information based 
on Bezier curve (Song et al., 2015). This method is used for unknown 
payloads as it does not rely on a mechanical model. 
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Soft robots have proven themselves to be compliant in object-handling 
tasks (Finio et al., 2013; Banerjee et al., 2018c; Chen et al., 2018; Tse et al., 
2018) in terms of conforming to the object surface, unstructured environ- 
ment, and unknown objects. Soft origami robots can also work in unstruc- 
tured environments (Chan et al., 2018; Banerjee et al., 2018b). 
Montmorillonite (MMT) hybrid nanocoatings were applied in the skin of 
soft robotic gripper to increase the stretchability in MMT/elastomer bilayer 
and it can endure direct flame contact without ignition (Chang et al., 2018). 
Soft robotic manipulator made of hyperelastic silicone rubber can produce 
safe and comfortable interactions with the subjects (Sun et al., 2016). It is 
widely used in minimally invasive surgery and applications that require 
closer inspection and operation. Hydrogel actuators and sensors are further 
used in soft robots especially for drug delivery, surgery, and biorobotics 
(Banerjee et al., 2018a; Ponraj et al., 2018; Banerjee and Ren, 2017). 

Combination of the soft actuator with tendon actuation based on flexible 
shafts is owned softness and three DOF (Tan et al., 2018a). A soft actuator is 
proposed with fused-deposition modeling technique and kinematics and 
statics performance are analyzed under different design and fabrication set- 
tings, different shapes of cross-sections, infill patterns, infill densities, etc. 
The technique was tested with a robotic hand, multisegment continuum 
robot and miniaturized drilling device. An interval-based framework of 
inherent uncertainties and pose evaluation for soft robots with flexible shafts 
were analyzed with a general model that extracted from prior kinematics 
models (Tan et al., 2018b). By bringing together the soft and rigid structures, 
a hybrid gripper with better object conformation and simple control can be 
realized. Such grippers could be advantageous in grasping tasks. Especially, 
envelop grasps can easily be performed with a hybrid gripper due to soft 
layers without external interactions (Ilievski et al., 2011). Besides, hybrid 
grippers have further been designed to grasp and hold the object under 
external disturbance (McKenzie et al., 2017; Mizushima et al., 2018). 

The flexible cable-driven robotic grasper is made with Lego-like mod- 
ules and length can be adjusted by adding or removing additional modules 
that are connected by magnets without the need for rerouting or breaking 
the cables (Li et al., 2017a). It uses the automatically reshaping method based 
on the motors current during the operation. Nonsingular fast terminal slid- 
ing mode algorithm is used for fast positioning and force tracking in the mul- 
tilateral teleoperation system with reconfigurable multifingered robot (Sun 
et al., 2018). It supports as an integrated perceptron for the operator in 
the multifingered robot. Another flexible, soft robotic manipulator was 
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implemented with six ionic polymer metal composite segments and used sta- 
tistics machine learning algorithms to plan the motion paths by learning from 
demonstration method (Wang et al., 2016). It overcomes the difficulty in 
path planning due to redundant DOF. 

Calibration of robotic systems can be categorized as robot-world cal- 
ibration, tool-flange (hand-eye) calibration, and kinematics calibration. 
Kinematics calibration is performed in several ways. The model that based 
on a minimal product of exponentials using only position measurements is 
accurate compared to the traditional model which uses position and ori- 
entation (Wu et al., 2015). The position of the robot base frame with 
respect to the world frame is analyzed under robot-world calibration. 
Calibration problem is framed as AX = Y B (Tan et al., 2018c) where 
A is partially known matrix and it is solved based on nonlinear optimiza- 
tion evolutionary computations. Hand-eye calibration is solved using 
AX = XB equation. 


2.3 Tactile sensing 


As the domain of robotic applications expands day by day, more challenges 
are being discovered with respect to object interaction and manipulation. In 
addition to the shape and size of the objects, it is additionally beneficial for 
the robot to understand the contact force dynamics, texture, and other phys- 
ical properties. 

Resistive sensors, capacitive sensors, optical sensors, ultrasonic-based 
sensors, piezoelectric sensors, magnetism-based sensors, and MEMS tac- 
tile sensors are few of the available types of tactile sensors. Tactile sensors 
specific to robotic applications have to be secured on to the robot’s sur- 
face seamlessly without affecting the functionality of the robot. For 
example, a bulky force sensor, at the tip of a robotic gripper, to measure 
contact force, might impede in grasping or object-handling tasks. Hence, 
as an additional requirement, tactile sensors for robotics have to be thin, 
flexible, and/or stretchable. Resistance and capacitance-based sensors are 
the two most widely preferred options for flexible and stretchable 
applications. 

The robotic gripper used in the tasks detailed in this chapter is equipped 
with 4 x 4 piezoresistive fabric flexible-based tactile sensors at the fingertips. 
Fabric-based piezoresistive tactile sensors are selected due to their simple 
design, ease of fabrication, and low cost. The tactile sensor is used to identify 
and monitor object-handling tasks by the gripper. 
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3 Object detection and hand-eye calibration 


Object identification is prevailing based on the imaging stream data 
(Guan et al., 2015; Nadeau et al., 2015; Shi et al., 2018; Ren et al., 
2011, 2017; Ren and Dupont, 2012) (or RBGD modality), analysis of depth 
data, estimation of object position and orientation (Guo et al., 2019), and the 
eye-hand calibration for a variety of applications. An overview of the vision 
perception task of object identification to centroid identification in UR5 
coordinate system is shown in Fig. 1. 
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Fig. 1 Overview of the vision perception task of object identification to centroid 
identification in UR5 coordinates. 
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3.1 Object identification using color stream data 


The object is identified using color detection algorithm by choosing lower 
and upper threshold values. Values should be selected accurately as it affects 
the sensitivity of the identification with the background (Fig. 2E). It is very 
sensitive to the changes in the lighting as well. Mask is created to save an 
image between the selected threshold window and it is used for the algo- 
rithms mentioned in the following sections (Fig. 2C). A wide range of edges 





(D) 


Fig. 2 Segments of object detection of Spanish fan. (A) Kinect v2, (B) an object in real 
space, (C) mask of the object under threshold value, (D) edge detected results, and 
(E) color object detection in success. 
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in the image can be detected using the multistage algorithm of Canny edge 
detection. Noise reduction is performed with a 5 x 5 Gaussian filter as the 
first step of the algorithm. It is used to filter with Sobel kernel in the hor- 
izontal and vertical direction which results in the first derivation of the hor- 
izontal (G,) and vertical direction (G,). Then, the edge gradient (G) and 
direction (8) can be calculated as 


GS4/ Gor G, (1) 
G, 
@ =arctan (2) (2) 


Nonmaximum suppression and hysteresis thresholding are performed to the 
results from the gradient. Finally, strong edges of the image can be obtained 
through this method (Fig. 2D). 

The algorithm was extended to find the contours of the captured view in 
color stream. Contour is a curve that joints all the continuous points, which 
is based on the same intensity or color. It can be calculated from the NumPy 
(Python library) array of coordinates in boundary points. Several contours 
may exist in the image as it captures the color detected results and the output 
of canny edge detection. A method is needed to implement for finding the 
contour of the target object with the others. 

Based on the contours, the image moment can be calculated as a 
weighted average of the intensities in image pixels. It is further used to find 
special properties to the image such as area, the center of mass and informa- 
tion on its orientation. Then, areas of all the contours have been calculated 
and a NumPy array is created from them. The maximum value is selected 
from it and is considered as the object that is required to be identified from 
the background. Calculation of the moment in the selected contour is per- 
formed and the values are stored in another NumPy array. Center of mass is 
further calculated from the moments that have been obtained previously 
(Fig. 3B). Raw moments can be calculated as 


Mpq = / / x? yf (x, y) dc dy (3) 


where p, g = 0, 1, 2, ..., f(x, y) is a 2D continuous function. 
Coordinates (C,, C,) of the center of mass are defined as 


— Mio 


Moi 
See Cy = 
Moo 


ie = 
Moo 


(4) 
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Fig. 3 Visualization of the center of mass and orientation in a Spanish fan. (A) Real-time 
object, (B) identified center of mass, and (C) center of mass with the suitable opening 
direction of the fan (orientation). 


3.2 Depth data 


The C, coordinate is required to obtain the complete 3D coordinates of the 
center of mass. It is collected from the depth data in Kinect v2. Near mode is 
enabled in Kinect v2 before proceeding to collect data from the depth sen- 
sor. It is more sensitive to closer objects that lie between 50 and 200 cm. 
Each pixel in the depth frame gives the pixel’s distance (in millimeters) from 
the Kinect sensor w.r.t. reference point. Since the RGB, and the IR camera 
are not located at the same location, the stereo vision problem arises, that is, 
coordinate values in one image are not the same in another image. To tackle 
this issue, image registration is conducted, which aligns RGB color stream 
values with depth values. Then, we can obtain the depth value of the cen- 
troid corresponding to the coordinates (x, y), which completes the 3D coor- 
dinates of the center of mass. 
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3.3 Orientation estimation 


An accurate estimation of the orientation of the fan is needed for the robotic 
arm to approach the fan before grasping it. The orientations are expressed as 
the angle (a) of the line passing through the center of mass and the midpoint 
of the two narrow edges of the contour with respect to the XY-plane, 
YZ-plane, and XZ-plane of the Kinect. It will result in roll, pitch, and 
yaw angles. An exact position is required by the URS for grasping the Span- 
ish fan as it concerns in opening and closing. Grasping the Spanish fan near to 
the center of mass is the best option that can be used to open the fan in a less 
force (Fig. 3C). Standard distance equations in trigonometry were used to 
calculate the angle a. This orientation estimation based on the Kinect data 
has a measurement accuracy of 1 degree. 


3.4 Hand-eye calibration 


The ROBOTIS Dynamixel SDK and the python-urx API are used in the 
control of the robotic gripper and robotic arm, respectively. The hand-eye 
calibration is performed between the UR5 and the Kinect v2 to establish 
the mapping relationship between the respective coordinates of the two 
devices. Chessboard pattern was used for the calibration. With the hand- 
eye calibration, the visual data read from the Kinect v2 can be directly sent 
to the UR5 for motion generation (Remy et al., 1997; Horaud and 
Dornaika, 1995). 

Six DOF includes positional data frame (x, y, z) as well as from orien- 
tational data frame (R,, R,, R-). Let A be the transformation between the 
two poses (positions and orientations for short) of the Kinect frame (x_pixel, 
y_pixel, z_pixel, R,pixel, R,pixel, R.pixel) and let B be the transformation 
between the two poses of the hand frame (x_robo, y_robo, z_robo, R,robo, 
Ryrobo, R.robo). Let X be the transformation between the robot frame and 
the Kinect frame. A, B, and X are related by the formula given by the 
following homogeneous equation. A is a 4 X 4 matrix. 


AX = XB (5) 
i: a: 
a= ( . ‘) (6) 


where Ry is a 3 X 3 rotation matrix formulated from (R,, R,, R.) and 


” 
ty = (x, y, 2) isa 3D column vector. 


Ra=RQ)R(A)R-(Y) (7) 


126 lyani N. Kalupahana et al. 





where yaw, pitch, and roll angles are represented by a, f, and y, respectively. 


1 0 0 
R,(a) =| 0 cos(a) —sin(a) (8) 
0 sin(a@)  cos(a@) 


cos(y) —sin(y) 
R.(y) = | sin(y)  cos(y) 
0 0 


(10) 


EE oS & 


In Kinect system, matrix A is obtained from calibrating the fixed chessboard 
pattern with its associated calibration frame. Consider, A; and A> as the 
transformations from calibration frame to Kinect frame at two different posi- 
tions (Fig. 4). A can be derived as 


A=A)-A;! (11) 


If B; and B> are considered as transformations from hand frame to base frame 
in positions 1 and 2, B can be derived as 


B=B;!-B (12) 


Let Y be transformation from hand frame to calibration frame. X can be cal- 
culated in the position 1 as follows: 


X=A,-Y (13) 
Applying Eqs. (11), (12), into Eq. (5) 
Az: Y=A,: YB (14) 


After the camera is calibrated to its extrinsic parameters (A;, to the position 
ith), matrix M; is decomposed into intrinsic and extrinsic parameters of a 
3 Xx 4 matrix. 
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Robot Frame 





Calibration 
frame 


Fig. 4 Calibration diagram w.r.t. different frames, transformation between frames and 
two positions is marked. 
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The parameters @,, @,, Wo, and vo describe the affine transformation 
between the camera frame and the image frame. By combining 
Eqs. (14), (15) 


M,- Y=M,- YB (17) 
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Projection of point P onto the image can explained as 


myx t+ Moy + 432 + M44 MX + Moy + M232 + M4 
= = 





— M31X + M32y F 11332 + M34 = 31x + Moy + 332 + M34 ae 
where u and v are the image coordinates of the p projection of P and mj are 
the coefficients of M,. x, y, and z represent the coordinates of P in the cal- 
ibration frame. Previous two equations describe the line passing through the 
center of projection and through p. It is given according to the calibration 
frame as well as to the Kinect frame. 

Closed-form solutions were implemented as separable solutions or 
simultaneous solutions. In separable solution, rotation is found first and posi- 
tional components found later (Shiu and Ahmad, 1989; Tsai and Lenz, 1989; 
Chou and Kamel, 1991; Horaud and Dornaika, 1995; Park and Martin, 
1994). In simultaneous solutions, rotation and positional components are 
found at same time (Daniilidis, 1999; Andreff et al., 1999). 





4 Planning and manipulation 
4.1 Hybrid robotic gripper 


The hybrid robotic gripper used in the experiments has a two-part structure. 
The first part is a rigid tendon-driven modular anthropomorphic gripper 
which acts as a skeleton for the whole device (Fig. 5A). It has five fingers 
similar to a human hand and each finger has two links and one DOF. 
The thumb has an additional DOF orthogonal to the existing one to imple- 
ment the abduction/adduction movement. The hand further has a single 
common joint in place of the metacarpals of the four fingers adding one 
more DOF. The links are designed in such a way that the internal joint 
angles do not exceed 180 degrees. The tendons are attached to servo motors 
and each of the seven DOF can be controlled individually by actuating the 
respective tendons. The modular design, kinematics, and the detailed expla- 
nation about the underactuated control of the gripper can be better under- 
stood from Li et al. (2017a) and Sun et al. (2018). 

The second part is made up of flexible soft layers which can be attached 
to or removed from individual fingers by means of stretchable silicone 
attachment bands. It has a layered architecture specifically designed to 
enhance the grasp and to assist in object-handling tasks of the gripper. 
A4 x 4 multitaxel piezoresistive fabric-based tactile sensor provides the nec- 
essary tactile feedback. It is encapsulated inside a thin soft layer at the rear side 
of the structure such that upon integration. It is sandwiched between the soft 
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L, - Base layer 
> ~ Spacer layer 
- Suction layer 





, ~ Enclosure layer 


(A) 


(C) 





(D) 
Fig. 5 The hybrid robotic gripper. (A) Rigid tendon-driven modular hand; (B) layered 
architecture of the soft layer; (C) actual soft layer; and (D) the combination of the 
rigid-soft parts. 


enhancement layers and the rigid links of the gripper. Due to the scope of the 
chapter, the tactile sensor is not discussed in detail here. A detailed explana- 
tion on the structure, working principle, related electronics, and calibration 
of such tactile sensors, can be perceived our previous works (Kirthika et al., 
2017; Ponraj et al., 2017; Ponraj and Ren, 2018). 
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The soft layers are made out of a soft yet strong and stretchable material 
EcoFlex™ 00-30 (Smooth-On, Inc., Macungie, PA, USA). The two-part 
precursors (EcoflexA and EcoflexB) are mixed in 1:1 ratio by weight and 
poured into the molds of required shapes. The mixture is cured at 80°C 
for 2 h to form a rubbery stretchable material. The dimensions of the struc- 
tures are custom made to fit over the rigid hand. The soft layers comprise 
alternative inflation and suction modules which can be pneumatically actu- 
ated by vacuum pumps controlling their positive and negative pressure, 
respectively. The suction module is used to enhance the grip and the infla- 
tion module is for increasing the contact between the hand and the object. 
While the tendons control the overall gripping motion and the orientation 
of the hand, the soft layers provide contact modulation to improve the grip. 
The dimensions and layered architecture of the suction and the inflation 
modules are as given in Fig. 5B. 

The suction module consists of four layers the base layer, the spacer layer 
to introduce gaps between the base and the suction layers, the suction layer 
with suction holes, and the enclosure layer to establish proper contact 
boundary with an object and to reduce air leaks. The layers are attached 
together using silicon glue to form a single suction module of dimensions 
20mm xX 20mm X 6mm approximately. A small tube of diameter 
1 mm was inserted into the spacer layer as a channel for the pneumatic actu- 
ation. When negative pressure is applied, the air between the suction layer 
and the object will be sucked out to create vacuum thus increasing the 
contact grip. 

The inflation module consists of two layers of thickness 2 mm sealed 
together at the boundaries. The dimensions of the inflation modules (with- 
out actuation) are 20 mm X 30 mm x 4 mm approximately. Similar to the 
suction module, a small tube is inserted between the layers to facilitate actu- 
ation. When positive pressure is applied, the air is pumped into the space 
between the two layers thus inflating the module. 

The suction and inflation modules are arranged alternatively and glued 
together to form a single soft finger (Fig. 5C). Additionally, thin soft strips 
are attached to the modules as extensions and loops to facilitate easy mount- 
ing over the rigid hand. The modules are arranged such that the suction 
module comes over the link of the rigid hand whereas the inflation module 
comes over the joint (Fig. 5C). The rationale behind such a design is to 
maximize the contact area between the robot and the object. During 
object-handling tasks using a rigid hand, the links of the gripper will come 
in contact with the object whereas the joints will remain untouched. By 
incorporating an inflation module over the joints, the gap between the 
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gripper and object can be filled providing maximum contact similar to a 
human handling an object. 

Each of the suction and the inflation modules were actuated using 12-V 
vacuum pumps individually. The normal operating pressure of the inflation 
module was in the range of 37-44 kPa whereas the suction module operated 
at —60 kPa. The variation in the operating range of the positive pressure is 
due to the fact that varying degrees of inflation is needed depending upon 
the space to be filled between the gripper and the object. 


4.2 Planning and control 


Corresponding to the seven DOF of the gripper, seven servo motors 
(Dynamixel MX-64RRobotis Dynamixel MX actuator, Lake Forest, 
CA, USA) are employed as the actuators, where each servo motor takes 
responsibility for one DOF. Torque control and position control strategies 
are used in the servo motor control during the fan manipulation. The open- 
ing and closing of the fan are performed by a combination of the robotic arm 
motion and the gripper manipulation. A python code was developed that 
moves the UR5 arm along a predefined trajectory following several 
waypoints while the gripper opens, closes, and adjusts the grip of specific 
fingers to manipulate the fan. Gravity and inertial force from the movement 
cause the fan to open and close. The opening and closing strategies of fan 
manipulation are shown in Fig. 6. 

Once the position and orientation of the fan were estimated from Kinect 
data, the UR5 robotic arm is moved to an initial position from the desired 
approach angle based on the hand-eye calibration. The fingers are positioned 
in close proximity to the fan (Fig. 6A) using position control mode. A firm 
grip is made using a torque control mode, where the fingers close around the 
object till the target torque is reached. Comparing with a position control 
mode, a torque control strategy is more flexible and adaptive. Rather than 
specifying a target position, it drives the servo motors to achieve a target tor- 
que thereby making it adaptive to objects of various sizes. The readings from 
the tactile sensor at the fingertip of the index finger provide confirmation 
that the gripper now firmly holds the fan (inset from Fig. 6B). It is to be 
noted that the tactile sensor here was not included as an active part of the 
feedback control loop, but rather used as a passive observatory device to 
monitor the task. 

The fan is then lifted up slightly above the surface of the table (Fig. 6B). 
Then the target torque value of the thumb is slightly increased such that an 
uneven force is applied on one side of the fan. This causes the fan blades to 
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Fig. 6 Sequential steps in opening and closing strategies of the Spanish fan (clockwise from top to left). (A) Gripper moving toward the fan; 
(B) pick the closed fan from the table. Inset shows response from the tactile sensor in the index fingertip when the gripper holds the fan; 
(C) adjusting grab strength to begin opening the fan; (D) partial opening of the fan further with gravity; (E) fully opened fan due to gravity and 
inertial force; (F) partially closed fan due to inertia from fast wrist rotation; (G) fully closed fan fully with grab strength adjustment and finger 
movements; (H) positioning the gripper to return the fan; and (I) fan placed back on the table. 
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slide across each other and open slightly (Fig. 6C). With an upward move- 
ment of the UR5 arm, the fan opens further due to the effect of gravity and 
inertial force (Fig. 6D). Simultaneously, the grip on the fan is adjusted by 
relaxing the target torques of the index and middle fingers while the thumb 
keeps pushing one end of the fan toward the palm. A deliberate jolt from the 
URS finally opens the fan completely. A fully open fan positioned parallel to 
the background wall can be seen in Fig. 6E. A combination of gravity and 
the inertial force due to the fast movement of the UR5 arm is the reason for 
the opening of the fan. The opening strategy is loosely based on how a 
human will open a fan using a single hand. 

A similar series of events are used to close the fan. First, the wrist of the 
robotic arm is rotated 90 degrees clockwise with respect to its z-axis. Due to 
the inertial force of this rotary motion, the fan closes to almost three-fourth 
of its size (Fig. 6F). It is closed completely by relaxing the thumb grip grad- 
ually and simultaneously closing the rest of the fingers to bring the other end 
of the fan blades together (Fig. 6G). The URS5 is now repositioned such that 
the gripper is ready to place the fan back at the table. One can see that the fan 
is now held between the dorsal side of the thumb and the ventral side of the 
other fingers (Fig. 6H). Except for this final finger configuration, the closing 
strategy is similarly based on human hand movement. Finally, the gripper 
opens and places the fan on the table by opening the thumb (Fig. 61). 

The entire series of tasks are based on rigorous revisions of trials to iden- 
tify suitable waypoints for the UR5 trajectory. A careful combination of 
URS and gripper manipulation has made the successful accomplishment 
of this task possible. During IROS 2018, the task was performed in our 
lab in National University of Singapore, Singapore and telecasted live online 
to the conference site in Madrid, Spain. While there were other teams, from 
all over the world, with dedicated industrial nonhumanoid gripper mecha- 
nisms, which can complete the task much faster, our solution presented in 
this chapter was the only one which performed the task single-handed sim- 
ilar to human hand motion. 





5 Data collection 


Experimental data are collected by placing the object (Spanish fan) at 
an angle in between —75 and 75 degrees to the x-axis and recorded the posi- 
tion of the center of mass and orientation to y-axis and z-axis as discussed 
under Sections 3.1—3.3. It produces six DOF data reference to Kinect coor- 
dinate system. The UR5 arm is moved to the desired target so that the end 
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effector (gripper) is ready to pick up the object. The position and orientation 
of the UR5 wrist are now recorded from the Polyscope robot user interface 
supported to URS. This gives a 6D position vector containing x-axis, y-axis, 
and z-axis coordinates and roll (Rx), pitch (Ry), and yaw (Rz) angles. The 
roll, pitch, and yaw angles define the orientation in which the robot will 
approach the object. The position data recorded from the console is precise 
with an accuracy of 0.1 mm. Linear and nonlinear regression models are 
fitted to make the relationship between the Kinect coordinate system and 
robot coordinate system (Fig. 7). Graphs are generated to six DOF in a robot 
coordinate system w.r.t. the independent variable orientation. 





6 Conclusion and future work 


This chapter presents an overview of real-time object detection and 
manipulation architecture for fan robotic challenge which is initiated by 
IROS 2018. A visual perception system is developed based on the Kinect 
v2 sensor and computer vision methods. Color and depth images from Kin- 
ect are collected for visual tasks. The proposed algorithm achieves at the per- 
formance rate of grasping the object in planned position, holding the fan, 
opening, and closing and positioning it back on the table. This method is 
more robust than stereo vision images and the cost is less with other tech- 
niques such as SURF, SIFT, SICK, etc. Soft layers in hybrid robotic gripper 
improve the grip in the task and tendons control the total gripping motion. 
As hybrid gripper, it realizes the better object conformation and simple con- 
trol even under environmental disturbance. Torque control strategy used in 
this application is more flexible and adaptive to grasp different sizes of objects 
in different environments. 

P-value is the level of marginal significance within the hypothesis test 
probability of occurrence of a given event. A smaller P-value is stronger evi- 
dence to reject the null hypothesis and agree with the alternative hypothesis. 
The null hypothesis Hp states that there is no significant relationship between 
angle and the variable given in the table. From the observed P-values 
(<.001), Ho can be neglected and can be concluded that there is a significant 
relationship with those two variables. Although the value of .027 is less than 
that of .05, a significant relationship between the variable is quite poor 
(Table 1). R value is the proportion of the variance for a dependent variable 
to an independent variable in the regression model. Correlation explains the 
strength of the relationship between an independent and dependent variable. 
Higher R* value (between 85% and 100%) indicates that the dependent 
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Fig. 7 The angle variations that are represented with y-axis (—75 to 75 degrees) to different coordinate systems that are represented in x-axis 
of each graphs. (A) x-axis in UR5 coordinate system; (B) y-axis in UR5 coordinate system; (C) z-axis in UR5 coordinate system; (D) Rxrobo axis in 
URS coordinate system; (E) Ryrobo axis in UR5 coordinate system; and (F) Rz,obo axis in UR5 coordinate system. 
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Table 1 Statistical data table of Kinect and robot frame, and R7 values. 





X_axis P-value R? (%) 
x_robo <.001 48.18 
y_robo <.001 98.18 
z_robo .027 15.80 
R,robo <.001 89.63 
R,robo <.001 94.56 
R.robo <.001 92.56 





variable is relatively in line with the independent variable. If the R° value is 
low (70% or less), it does not follow the movement of the independent var- 
iable. y_robo, R,1obo, Ryrobo, R.robo fit the regression model in the range of 
85%-100% R°. 

z_robo have comparably low R? values to fit with the model. Hence, 
their values acquired based on the model might not be accurate. Since R* 
value does not sufficiently verify the accuracy of the chosen model, we fol- 
low the residual plots for further analysis. Residual plots determine whether 
a regression model is appropriate for the given data. As patterns can be 
observed (Fig. 8) from residual points, nonlinear models are appropriated. 
Regression models were difficult to plot on the independent variables of 
x_robo, y_robo, and z_robo as its points are randomly distributed on the 
axis. Z coordinate of the gripper and Kinect can be varied as those are 
not parallel and belongs to an intermediate state of another axis as well. 

The program can be developed to recognize simple equipment that is 
easy to manipulate by human hand. Using the same procedure with 
developing algorithms, we are able to navigate that equipment through 
robot hand. In the future, advanced techniques like Dex-Net 2.0 deep 
learning robust robotic grasp will be investigated to detect an object 
from multiple objects for more complex tasks. As a follow up of the cur- 
rent work, the tactile sensor array will further be exploited by analyzing 
the data during the transition stages to meticulously control the entire 
process based on its feedback. Frequency domain analysis of tactile data 
could further be used for advanced slip detection and slip prevention 
controls. 
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1 Introduction 


Biological cell injection is a method used for the insertion of small 
amount of substances, such as biomolecules, sperms, genes, and proteins, 
into the suspended or adherent cells. It is widely used in gene injection 
(Kuncova and Kallio, 2004), drug development (Nakayama et al., 1998), 
intracytoplasmic sperm injection (ISCI) (Yanagida et al., 1999), and 
in vitro fertilization (IVF) (Sun and Nelson, 2002). For example, in IVF, 
the sperm is injected into matured eggs for the treatment of infertility. Sim- 
ilarly, drug development involves the injection of drugs into a cell and the 
observation of its implication at the cellular level. 

Robotic cell injection systems can automatically perform the task of cell 
injection as opposed to the conventionally used manual and semiautomated 
injection procedures, which require trained operators and involve time- 
consuming processes and also have low success rates. The most important 
parameters of a robotic cell injection system are coordinate frames, capturing 
the orientation and movement of its various components such as injection 
manipulator, digital cameras, sensors and microscope, and the force control- 
ling the injection pipette (Huang et al., 2009a). A slight error in the orien- 
tation and movement of these components may result in injection into an 
undesired part of the cell. Similarly, a slight excess of force may damage 
the membrane of the cell (Huang et al., 2006) or an insufficient force 
may not be able to pierce the cell (Faroque and Nizam, 2016). Thus the 
accuracy of the orientation and movement of these fundamental compo- 
nents and the injection force are vital for the reliability of the overall system. 
Therefore, the robotic cell injection system designs need to be analyzed and 
verified quite carefully to ensure that these requirements are exhibited by the 
final systems. 
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A robotic cell injection system is generally categorized into three types, 
namely 2-degree of freedom (DOF), 3-DOF, and 4-DOF, based on the 
DOF of the cell injection manipulator that is mounted on the motion stage 
and controls the motion of the injection pipette. The first step in the analysis 
of a robotic cell injection system is to model the coordinate frames 
corresponding to the orientations of its various components, such as the 
injection manipulator, cameras, and images. This model allows us to capture 
the movement and thus the positions of these components during the pro- 
cess of cell injection. Moreover, the relationship between these coordinates 
provides the relative positions of these components, which is an essential part 
ofa successful cell injection procedure. Next, in order to perform the process 
of cell injection, the motion planning of the injection pipette is modeled 
using some force control algorithms, such as the contact-space-impedance 
force (Sun and Liu, 1997; Huang et al., 2009a) and the image-based torque 
controllers (Huang et al., 2006). These controllers capture the overall 
dynamics of the system and are mainly responsible for successful cell injec- 
tion procedure and smooth functionality of the overall system. 

Conventionally, the robotic cell injection systems have been analyzed 
using paper-and-pencil methods. However, these manual analysis tech- 
niques are prone to human error and also are not scalable for analyzing com- 
plex models like the robotic cell injection systems. Moreover, in some cases, 
all the required assumptions are not documented in the mathematical anal- 
ysis, which may lead to erroneous designs and analysis. Similarly, the 
computer-based simulations and numerical techniques have been used for 
analyzing these systems. However, due to the involvement of the 
continuous-time (differential equation-based) models of the system in the 
analysis and the limited amount of computer memory and computational 
resources, the system is analyzed for a certain number of test cases only 
and thus the absolute accuracy cannot be achieved. Computer algebra sys- 
tems, such as Mathematica (Mathematica, 2019), have also been used for 
analyzing these systems (Nethery and Spong, 1994). However, the symbolic 
algorithms residing in the core of these systems are unverified (Duran et al., 
2013), which compromises the accuracy of these analyses. Due to the safety- 
critical nature of robotic cell injection systems, the above-mentioned con- 
ventional methods cannot be trusted as they are either prone to error or 
incomplete, which may lead to an undetected error in the analysis that 
may in turn lead to disastrous consequences. 

Formal methods (Hasan and Tahar, 2015) are computer-based mathe- 
matical analysis techniques that can overcome the above-mentioned 
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inaccuracies. Primarily, these techniques involve the development of a 
mathematical model of a system and verification of its properties using 
computer-based mathematical reasoning. There are mainly two types of for- 
mal methods, that is, probabilistic model checking (Clarke et al., 1999) and 
higher-order-logic theorem proving (Harrison, 2009), that have been used 
in this context. Probabilistic model checking involves the development of a 
state-space-based probabilistic model of the underlying system and the for- 
mal verification of its intended properties that are specified in temporal logic. 
It has been used by Sardar and Hasan (2017) for analyzing the robotic cell 
injection systems. However, the formal model involves the discretization 
of the differential equations modeling the dynamics of these systems, which 
compromises the accuracy of the corresponding analysis. Higher-order-logic 
theorem proving (Harrison, 2009) is an interactive verification method that 
can overcome these limitations. It primarily involves developing a mathe- 
matical model of the system based on higher-order logic and verifying its 
properties based on deductive reasoning. Given the high expressiveness of 
higher-order logic, it can truly capture the behavior of differential equations, 
which is not possible in the probabilistic model checking-based analysis. 
Rashid and Hasan (2018) have recently used this technique for the formal 
verification of the same robotic cell injection system. This chapter presents 
an overview of these efforts, which includes the formal verification of these 
systems using probabilistic model checking and higher-order-logic theorem 
proving. Finally, it highlights the strengths and weaknesses of these tech- 
niques for analyzing robotic cell injection systems. 

The rest of the chapter is organized as follows: Section 2 provides some of 
the related work that has been done for analyzing the robotic cell injection 
systems. We provide a brief overview of the formal methods, that is, model 
checking and theorem proving in Section 3. Section 4 presents the formal 
verification of the robotic cell injection system using probabilistic model 
checking. We present the formal analysis of the robotic cell injection system 
using higher-order-logic theorem proving in Section 5. We provide some 
discussion about the analyses, presented in Sections 4 and 5, while highlight- 
ing their strengths and weaknesses in Section 6. Finally, Section 7 concludes 
the chapter. 





2 Related work 


Huang et al. (2006) have proposed a vision-based force control frame- 
work for the robotic cell injection systems. The authors have used 
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biomembrane point-load model for the measurement of the injection force 
using visual cell deformation feedback. They have also developed a two- 
dimensional impedance force control strategy for the process of the robotic 
cell injection. Similarly, Huang et al. (2007) have presented a vision-based 
impedance force control algorithm for analyzing the three-dimensional cell 
injection systems. The authors have used xy coordinate frame deformation 
of the cell and microscope for the measurement of the total cell deformation 
during the process of cell injection. Later, the same authors have proposed a 
prototype cell injection system for automatic batch injection of suspended 
cells (Huang et al., 2009b). A force sensor is used to measure the real-time 
injection force applied to the cells during the process of cell injection. More- 
over, a force control algorithm is developed and also used for controlling the 
motion of the injection pipette during an out-of-plane cell injection. How- 
ever, all contributions presented earlier are based on conventional tech- 
niques and cannot be trusted, considering the safety-critical nature of the 
robotic cell injection systems. 

Formal methods, such as probabilistic model checking and higher-order- 
logic theorem proving, have also been used for the formal analysis of the 
robotic cell injection systems. Sardar and Hasan (2017) have used probabi- 
listic model checking (Clarke et al., 1999), that is, a state-based formal 
method, to formally analyze the robotic cell injection systems. However, 
their methodology involves the discretization of the differential equations 
that model the dynamics of these systems, which compromises the accuracy 
of the corresponding analysis. Moreover, the analysis also suffers from the 
inherent state-space explosion problem (Clarke et al., 2012). Recently, 
Rashid and Hasan (2018) have proposed to use higher-order-logic theorem 
proving for formally analyzing the robotic cell injection systems. The 
authors have formalized various coordinate frames and formally verified 
their interrelationship. Moreover, they have also formally analyzed the 
dynamical behavior of these systems and the motion planning of the injec- 
tion pipette used in the process of cell injection. The main focus of this 
chapter is to present the efforts that have been made in these formal 
method-based analyses of the robotic cell injection systems. 





3 Formal methods 


3.1 Probabilistic model checking and PRISM 
Model checking (Clarke et al., 1999) is one of the major formal techniques 
that is commonly used for analyzing concurrent systems, such as network 
and routing protocols. The model checking-based analysis involves the 
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Fig. 1 Model checking. 


construction of a state-space model of the given system and specification of 
the intended properties of the system in temporal logic (Pnueli, 1977), as 
depicted in Fig. 1. Next, both the model and properties are given to the 
model checker, which explores the state space exhaustively and automati- 
cally verifies the given system based on these properties. In the case of failure 
of a property, the model checker generates an error trace, which helps a user 
to identify and rectify the error found in the system’s model. For larger sys- 
tems, this technique is subject to the problem of state-space explosion (Baier 
and Katoen, 2008) caused by the limited availability of computer memory 
and other computational resources. The abstraction of the model or usage of 
the efficient bounded and symbolic model checking techniques are generally 
used to overcome this problem. 

PRISM (Kwiatkowska et al., 2011) is a probabilistic model checker that 
is widely adopted for the modeling and analysis of the systems exhibiting 
probabilistic behaviors. It involves the development of a state-space model 
of the underlying system by assigning probabilities to its various transitions. 
Next, the intended properties, captured in temporal logic, are verified for 
the state-space model, developed in the previous step. Based on the nature 
of the underlying system, that is, discrete time or continuous time, it sup- 
ports various types of probabilistic models such as discrete-time Markov 
chains (DTMCs) (Kulkarni, 2016), continuous-time Markov chains 
(Kulkarni, 2016), probabilistic timed automata (Puterman, 2014), and 
Markov decision process (Segala and Lynch, 1995). 

The formal model of a system is developed using a state-based language, 
that is, PRISM language, which is based on Alur’s reactive modules formal- 
ism. PRISM language provides several fundamental components, that is, 
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modules and variables, for the development of a model. A PRISM model gen- 
erally consists of several modules, which can interact with each other. 
A module contains a set of local variables and guarded commands. The values 
of these variables at a time instant provide the state of the modules. More- 
over, the guarded commands capture the behavior of the modules. The global 
state of the overall system is identified by the local states of all modules. The 
syntax of a PRISM command is given below: 


[] guard -> prob_l : update_l + ...+ prob_n : update_n; 


The guard is a predicate over all variables. If it is true then it allows the tran- 
sition of states and performs the update of states based on the initially assigned 
probabilities of the transitions. 

The PRISM model of a system can be formally verified using the prop- 
erties specified in probabilistic temporal logics, such as probabilistic compu- 
tation tree logic (PCTL (Hansson and Jonsson, 1994) and PCTL» (Aziz 
et al., 1995)), continuous stochastic logic (Aziz et al., 1996), probabilistic 
linear temporal logic, and nonprobabilistic temporal logic computational 
tree logic (Orgun and Ma, 1994), which are formulas in temporal logic 
and support specifications based on temporal, path, logical, probability, 
and reward operators. The supported temporal operators include next 
(X), always (G), and eventually (F). Similarly, the path operators are there 





exists (E) and forall (A), whereas negation (!), disjunction (|), conjunction 
(&), and implication (=>) are the logical operators. The probability oper- 
ators include probability (P), maximum probability (Pmax), and minimum 
probability (Pmin). Similarly, the reward operator involves reward (R). 
Table 1 presents the property specification, the temporal and path operators, 


and their graphical representation. 


3.2 Theorem proving and HOL Light 


Theorem proving (Harrison, 2009) involves constructing a mathematical 
model of the given system and the intended properties of the system based 
on an appropriate logic as shown in Fig. 2. Next, both the model and prop- 
erties are presented as theorems to the theorem prover, which uses deductive 
reasoning to develop their proofs based on well-known axioms and hypoth- 
esis and thus verifies the given system based on these properties. Based on the 
decidability or undecidability of the underlying logic, that is, propositional 
or higher-order logic, theorem proving can be automatic or interactive, 
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Table 1 Property specification using the temporal and path operators. 
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respectively. Every theorem prover comes with a set of axioms and inference 
rules, which, along with the already verified theorems, are the only ways to 
prove the new theorems. This purely deductive feature ensures soundness, 
that is, every sentence proved in the system is actually true. 
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Fig. 2 Theorem proving. 


HOL Light (Harrison, 1996a) is a higher-order-logic proof assistant that 
ensures secure theorem proving using the Objective CAML (OCaml) lan- 
guage, which is a variant of the strongly typed functional programming lan- 
guage ML (Paulson, 1996). HOL Light users can interactively verify 
theorems by applying the available proof tactics and proof procedures. 
A HOL Light theory consists of types, constants, definitions, and theorems. 
HOL Light theories are built in a hierarchical fashion and new theories can 
inherit the definitions and theorems of their parent theories. HOL Light 
provides an extensive support for the analysis based on Boolean algebra, real 
arithmetics, multivariable calculus, and vectors (Harrison, 2013). There are 
many automatic proof procedures (Harrison, 1996b) available in HOL 
Light, which help the user in concluding a proof more efficiently. 

Table 2 illustrates some symbols, that is, their HOL Light and standard 
representations, and their meanings, which have been very often used in this 


chapter. 





4 Model checking-based analysis of robotic cell 
injection systems 
4.1 Robotic cell injection systems 
A robotic cell injection system is generally composed of three modules, 
namely executive, sensory, and control modules as depicted in Fig. 3. 
The executive module comprises positioning table, working plate, and 
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Table 2 HOL Light symbols. 
HOL Light symbols Standard symbols Meanings 
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\/ Or Logical or 
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Fig. 3 Robotic cell injection systems. 
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Fig. 4 Configuration of the robotic cell injection systems. 


the injection manipulator. The cells that need to be injected are placed on a 
working plate, which is mounted on a positioning table (XY 6-axis) and the 
injection manipulator is mounted on Z-axis as shown in Fig. 3. 

The sensory module consists of a vision system that has four parts, namely 
charge-coupled device (CCD) camera, peripheral component interconnect 
(PCI) image capture, optical microscope, and a processing card. The CCD 
camera is used to capture the process of the robotic cell injection using a PCI 
image capture. The control module comprises a host computer and a 
DCT0040 motion control system. Fig. 4 depicts the configuration of a 
robotic cell injection system. The axis 0 — xyz represents the stage (table 
and working plate) coordinate frame, where o is the origin of these coordi- 
nates representing the center of the working plate and z is along the optical 
axis of the microscope. Similarly, 0, — x,y,z, represents the camera coordi- 
nate frame where 0, is the center of the microscope. The coordinate frame in 
image plane is represented by 0; — uv, where 0; is the origin and the axis uv is 
perpendicular to the optical axis. 


4.2 Proposed formal model 


Probabilistic model checking (Baier and Katoen, 2008) was used by Sardar 
and Hasan (2017) for the formalization of the robotic cell injection systems. 
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This model incorporates various random factors that are vital for the analysis 
of these systems due to their safety-critical nature. Probabilistic model 
checking has been widely utilized for analyzing a variety of systems 
exhibiting the probabilistic or random behavior that belong to various 
domains, such as randomized distributed algorithms, security, communica- 
tion and routing protocols, biological systems, etc. The proposed model 
supports quantitative analysis while capturing the real-world factors of ran- 
dom nature and thus helps in determining the efficiency of these systems. 


4.2.1 Proposed modeling approach and formalization 

The force control module of the robotic cell injection systems is modeled as a 
closed-loop control system since it involves a feedback loop from the output 
to the input of the underlying system and thus can provide a better perfor- 
mance by minimizing the peak error as compared to the open-loop system. 
Fig. 5 depicts the model for the control of the injection pipette’s trajectory in 
the X-coordinate. The term plant is used for the robotic cell injection system 
to distinguish it from the rest of the controller. The variable X, represents the 
desired position of the pipette, whereas the position of the pipette, given by 
the encoder, is denoted by X,,. The difference of both these positions, that is, 
e, = X,— X,, denotes the trajectory error in X-axis. The disturbances (inter- 
nal and external) are modeled as additive noise. The injection pipette con- 
trollers adjust the driving motor’s input torque 7, using the error e,. and the 
current value of the external force f,,. applied to the actuators. The resulting 
torque T,,is provided to the plant, which is further used to compute the actual 
position of the injection pipette X. The measurement noise due to various 
factors, such as encoder noise, calibration error, fabrication variation, is 
modeled as additive noise to X, providing X,,, which is fed back to the con- 
troller (Sardar and Hasan, 2017). 
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Fig. 5 Closed-loop model of the system (Sardar and Hasan, 2017). 
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Our proposed formalization of the robotic cell injection systems is 
based on DTMC and involves the discretization of the implementation of 
the actual system. In the case of the robotic cell injection systems, there is 
a specific time interval for capturing the images of the injected cell using 
CCD camera. Also, it requires time to process the values of radius a and 
depth w, of the dimple created. These values are used to estimate the force 
feX, which is fed to the controller for the computation of the torque Tau_x, 
as depicted in Fig. 6. After adding disturbances (internal and external), the 
resulting torque Tau_n is provided to the plant’s motor. This noise also cor- 
rupts the actual position of the pipette X_cur resulting in encoder measure- 
ment X_n. Finally, the error ex in the trajectory of the pipette is computed 
and fed back to the force controller (Sardar and Hasan, 2017). We consider 
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Fig. 6 Finite state-space model of the robotic cell injection system (Sardar and 
Hasan, 2017). 
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Fig. 7 PRISM modules and their interconnections (Sardar and Hasan, 2017). 


one time unit as the total time taken during the process of robotic cell injec- 
tion. This process is repeated at each time instant for various tasks, such as 
prepiercing, piercing, injection, and injector pulling out periods. These tasks 
are repeated for each of the new cells and this process continues in this man- 
ner to provide the injection for the whole batch of cells. Our PRISM model 
comprises four main modules: plant, controller, noise, and disturbance, and 
their interaction is shown in Fig. 7. The plant module models the dynamics 
of the plant. The control module implements the image-based force con- 
troller capturing the movement of the pipette. The noise and disturbance 
modules provide our formalization of the internal and external disturbance, 
as well as the measurement noise (Sardar and Hasan, 2017). 


4.3 Formalization of the plant 


The main modules and the configuration (orientation of various coordinate 
frames) of the robotic cell injection systems are depicted in Figs. 3 and 4. 
The image-stage coordinate frame interrelationship is mathematically 


u| | fecosa frcosa] | X fed 
Jeleentel i) 


where f. = 2/6, and f, = 4/6, are the display resolutions of the vision system 


expressed as 


in x- and y-directions, respectively. Here, A represents the magnification 
factor of the microscope objective. Similarly, 6,, and 6, denote the actual dis- 
tances between the two adjoining pixels in the CCD sensor u-v coordinate 
frame. The variables dx and dy denote distances between the stage and the 
camera coordinate frames in x- and y-directions, respectively. Also, a 
represents the angle between the stage and the camera coordinate frames. 
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The dynamics of the 2-DOF motion stage, based on Lagrange’s equa- 
tion, is mathematically expressed as 


dx dx 
my t+my+m, 0 | dt | Hl dt | _ ig _ ] 2) 
0 my + my | | d?y 0 1] | dy ty fey’ 
dt. dt 


where m,, m,, and m, are the masses of the working plate and the x and y 
positioning tables, respectively. Similarly, 7, and t, model the x and y com- 
ponents of the input torque to the driving motor, respectively. Similarly, fex“ 
and fey” present the x and y components of the desired external force applied 
to the actuators during the process of cell injection. 

Using the values obtained from the real-world experimental setup in 
Eq. (2), we obtain the following second-order differential equation after 
simplification (Sardar and Hasan, 2017): 


0.022180X + (2.465e— 0.03) X? —0.0479X = 1.5 x 1077 (ty — fre) — 1.146 
(3) 


The earlier differential equation is discretized to its corresponding differen- 
tial equation by using finite difference method (LeVeque, 2007) having 
backward difference operators. We utilize the first-order approximation 
to avoid the overhead cost generated by higher-order difference approach. 
Representing the value of the variable X at time instant ¢; as X;, the first- 
and second-order derivatives of X using the backward difference method 
are mathematically expressed as Sardar and Hasan (2017) 





. oe. 
x = (4) 
At 
Xj — 2Xj-1 + Xj-2 
i: = 2 (5) 
(Ar) 


where Af denotes the step size for time. Similarly, X;_,; and X;_2 represent 
the value of X at time instants f;_ and t;_2, respectively. Using these values 
in Eq. (3) and ignoring the higher-order terms, the solution for X;, for At= 1 
after simplification and rounding off the values to six decimal places, is given 
as (Sardar and Hasan, 2017) 


Xj = — 77.143817Xj-1 + 39.510075 Xj_2 


(6) 
— 5.926511 x 107°(z, — fey.) + 45.278546 
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The earlier equation is formalized in PRISM as follows (Sardar and Hasan, 
2017): 


EJ) quare => O_cur > = ceil (ol © xX ole + joe » cole = 
os (Ta = ae) ae jo) be 


where X_cur represents the current position of the injection pipette along 
the X-axis. Similarly, X_old1 and X_old2 capture the pipette’s position 
along the X-axis at time instants ¢;_, and f;_», respectively. Moreover, p1, 
p2, p3, and p4 are defined as constants in PRISM and their values are 
obtained from Eq. (6). Moreover, TauX represents the per-unit torque 
input to the driving motors and feX is the external force applied to the actu- 
ators during the process of the robotic cell injection. Since PRISM does not 
support rational numbers for state variables, we utilized the PRISM function 
ceil to round the final result to the nearest integer value. Moreover, the 
guard represents the condition for sequencing using a global variable count. 


4.3.1 Formalization of the controller 
The biomembrane point load model (Sun et al., 2003) is used for the vision- 
based estimation of the cell injection force F, which is mathematically 
expressed as 
_ 2nEhw} 3-407 +0°+2 Ing? 
ey) ia aes dae’): 


where E and h represent the membrane elastic modulus and thickness of the 





(7) 


biomembrane, respectively. Similarly, w, denotes the depth of the dimple 
resulted due to injection of the pipette and a represents the radius of the dimple 
after injection of the pipette. 7 is the Poisson ratio and € = c/a, where cis the 
radius of the pipette. Eq. (7) is formalized in PRISM as Sardar and Hasan (2017) 


EL J] quarrel -> (Force = wim (eel (C2 © ol * EM © i * pow Cua, 3)) © 
(3 = 4 2 joy Cev/a,2) 4 wo Cova) = 2 log Coow Ce/a,2).2)) 7 
(Qo (a,2) * Cl = ganime)) “ Cl = pow Ceva.2)) © 
pow ((1 - pow (c/a,2) + log (pow (c/a,2),e)),3))), 
Force_max) ) 


where the variable Force captures the injection force and EM denotes the 
membrane elastic modulus. Similarly, e and pi are defined as constants in 
PRISM. The PRISM functions pow (ij) and log (i,j) compute i to the 
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power of j and the log of i to the base j, respectively. Similarly, the function 
min (i,j) accepts two values i and j and returns the minimum out of those 
values. It is utilized to restrict the values of the applied force under its upper 
bound Force_max. 

To reproduce the image processing results using our proposed approach, 
aand ware modeled differently in the four different time zones: prepiercing, 
piercing, injection, and pulling out of the injection pipette. During the pre- 
piercing phase, the values of a and w, increase by a nondecreasing factor due 
to the increasing velocity, whereas their values decrease during the piercing 
phase. Similarly, during the injection phase, they remain constant. Finally, 
the values decrease initially and then increase during the pulling out period. 


4.3.2 Formalization of the random factors 

Two main random factors have been incorporated into our PRISM model, 
which are classified as either disturbance or measurement noise. Disturbance 
can be further categorized into types: internal and external disturbances 
(Sardar and Hasan, 2017). The internal disturbances include plant uncer- 
tainties, such as electromagnetic effects of the components of the system, var- 
iation in parameters of the process, and distortion due to nonlinear elements 
(Dorf and Bishop, 2011). External disturbances mainly occur due to the 
environmental effects, such as temperature and electromagnetic effects of 
components in the surrounding. For example, the high temperature may 
cause the image degradation (PULNixX, 2017), which may introduce an 
error in the values of the parameters a and wy of the biological cell. The mea- 
surement noise is caused by the sensor error, which includes calibration error, 
fabrication variation, and the lifetime of the sensor (Dorf and Bishop, 2011). 
The amount of the noise is characterized by the noise-to-signal ratio (Levine, 
1999). Our PRISM models of the disturbance and measurement noise are 
depicted in Figs. 8 and 9. Since the disturbance is generally greater than 


Probability 
o' oO 
Ne) wo 


° 
ae 


0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 
Noise-to-signal ratio 
Fig. 8 Model of the disturbance (Sardar and Hasan, 2017). 
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Fig. 9 Model of the measurement noise (Sardar and Hasan, 2017). 


the measurement noise, the noise-to-signal ratios of 0.1—0.9 are used for dis- 
turbance, with the peak value at 0.05, as shown in Fig. 8. We implemented 
this in PRISM as follows (Sardar and Hasan, 2017): 








EJ] quared => O.02e(laum” = cai) (lrawioe st WO © Wawa) a 
O.WSs(TauLm” = cei (lau 4 O02 * Taio) 3 
O.WSs(Taun” = ceil (lrauioe e+ O08 * Tas) a 

O.2sCiewLin’ = call Ciawiox a O04 & Tawi) 
DessClewLin” = carl Chavo = OS & TawiLog))) 
Oeste’ = carl Crave = 00 & Tawi) 
0.083 (TauLin” = ceil (lavise a O07 © Taisx))) 3 
O.053Clawin® = ceil Claus + O08 © Taw) 
O.023 (lawn? = ceil Claus + @.09 © Tawi) )s 




















where Tau_x and Tau_n represent the per-unit torques from the controller 
and after the addition of distortion. 

The noise-to-signal ratios of 0.1-0.5 are used for measurement noise, 
with peak value at 0.03, as shown in Fig. 9. This is implemented in PRISM 
as follows (Sardar and Hasan, 2017): 


LJ quarcd -> @,.05s(%_m° =| ceil CLeur + 0.0 © kX cur)? 
O.230x im” = ceil Occur + 0.02 © YX ewuir)) 
530m” = ceil Occur + 0.03 © X euir)) 
.23Cx m” = ceil Oxcurr + 0.04 © eur) 

O.053QCim” = ceil Occur + 0.05 © Ycuir) ye 


+ + + + 
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where X_cur denotes the position of the pipette on the X-axis and X_n 
represents its position after adding the measurement noise of the encoder. 





5 Theorem proving-based analysis of robotic cell 
injection systems 


This section provides the theorem proving-based formal analysis of the 
robotic cell injection systems, which mainly includes the higher-order-logic 
formalization of various coordinate frames and their interrelationship. It also 
includes the formal verification of the solutions of the differential equations 
capturing the continuous dynamics of the 2-DOF robotic cell injection 
systems using HOL Light theorem prover. Moreover, we also present the 
formal modeling of the torque and force controllers and the formal verifica- 
tion of their implication relationship. 

In order to facilitate the understanding of the chapter, the formal analysis 
of the robotic cell injection system is presented using a mix Math/HOL 
Light notation. 


5.1 Formalization of the coordinate frames and their 
interrelationship 
The coordinate frames of a robotic cell injection system, such as camera, 
image, and stage coordinates, are generally modeled as two-dimensional 
coordinates. These coordinates are modeled in HOL Light as follows 
(Rashid and Hasan, 2018): 
Definition 5.1. Two-dimensional coordinates 


ger VX Y t. two_dim_coordin x y t = ka 
3 (t) 


where x: R—R and y: R—R are functions of time modeling the 
respective axes and t is a variable representing the time. 

Next, we model a matrix providing a rotation from the stage coordinate 
frame (0 — xyz) to the camera coordinate frame (0, — x,y,z,), and the two- 
dimensional vector representing the displacement between the origins of 
both these frames (Rashid and Hasan, 2018): 


Definition 5.2. (Rotation matrix and displacement vector). 


cosa at 


b a. rotat_matrix a= : 
der V = —sina cose 


Fger Vdx dy. displace_vector dxdy= haa | 


where oa denotes the angle between the two frames. Similarly, the 
variables dx and dy denote distances between the two coordinate frames 
in x- and y-directions, respectively. 
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The camera, image, and stage coordinate frames ensure the correct 
orientation and movement of various components ofa robotic cell injection 
system, like, injection manipulator, microscope, stage frame, etc., and 
are mainly responsible for a reliable operation of the system. Therefore, 
the verification of the relationship between these coordinate frames is 
of utmost importance. The camera-stage coordinate frame interrelationship 
is formally verified by the following HOL Light theorem (Rashid and 
Hasan, 2018): 

Theorem 5.1. Camera-stage coordinate frame interrelationship 
F thm VXC yo X y aw dx dy t. 

[At]: 0 < dx A [A2]: 0 < dy 


=>(relat_camera_stage_coordinxcycxyadxdyts 


en] | x(t)* cosat+y(t)* Sinat+dx 


yc(t) —x(t)* sinaty(t)* cosat+dy 


where the function relat_camera_stage_coordin represents the camera-stage 
coordinate frame interrelationship. Assumptions A1-A2 ensure the nonnegativity of the 
distances dx and dy, respectively, and are design constraints for the relationship. The ver- 
ification of the previous theorem is based on the properties of vectors and matrices alongside 
some real arithmetic reasoning. Now, to verify the image-camera coordinate frame 
interrelationship, we require modeling the display resolution matrix (Rashid and 
Hasan, 2018): 
Definition 5.3. Display resolution matrix 


fx 0 
0 fy 


where fx and fy are the display resolutions of the vision system in x- and 


F ger Vix fy. display_resol_matrix fx fy = 


y-directions, respectively. Next, the image-camera coordinate frame inter- 
relationship is verified as 
Theorem 5.2. Image-camera coordinates interrelationship 
Finm VXC yo uv t fx fy. 
[At]: 0 < fx A [A2]: 0 < fy 


=>(relat_image_camera_coordinxc ycuvtfx fys 
u(t) fxX*xc(t) 
v(t) 7 fyxyc(t) 


where the function relat_image_camera_coordin provides the image-camera coor- 
dinate frame interrelationship. Assumptions A1-A2 of Theorem 5.2 model the design 
constraints for the relationship, that is, the nonnegativity of fx and fy, respectively. 
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Next, to verify the image-stage coordinate frame interrelationship, given in Eq. (1), 
we require modeling the transformation matrix: 


Definition 5.4. Transformation matrix 


fx*xcosa fxxSina 
—fyxsina fy*xcosa 


Faer VEX fy a. transform_matrix fx fy a= 
Now, the image-stage coordinate frame interrelationship (Eq. 1) 1s 
verified as 
Theorem 5.3. Image-stage coordinates interrelationship 
Finm VX y uv t fx fy dx dy a xc yc. [Al]: 0 < dx A [A2]: 0 < dy A 
[A3]: 0 < fx A [A4]: 0 < fy A 
[A5]: two_dim_coordin u v t = display_resol_matrix fx fy ** 
two_dim_coordin xc yc tA 
[A6]: two_dim_coordin xc yc t = rotat_matrix a ** 
two_dim_coordin x y t + displace_vector dx dy 
= two_dim_coordin u v t = transform_matrix fx fy a ** 


two_dim_coordin x y t + | 


fy*dy 

where ** represents the operator for the multiplication of a matrix with a vector and 
vice versa. Assumptions A1-A4 present the design constraints for the image-stage coor- 
dinate frame interrelationship. Assumption A5 models the image-camera coordinates 
interrelationship. Similarly, Assumption A6 provides the camera-stage coordinate frame 
interrelationship. Finally, the conclusion captures the relationship between the image and 
stage coordinate frames. The proof process of Theorem 5.3 is mainly based on Theorems 
5.1 and 5.2 along with some properties of the vectors and matrices. The verification of 
these relationships ensures the correct orientation and movement of various components of 
the robotic cell injection system, that is, injection manipulator, working plat, microscope, 
camera, etc., and is vital considering the safety-critical nature of the underlying system. 

Next, we model the dynamics of the robotic cell injection systems, 
which are generally modeled as a set of differential equations and formally 
verify the solution of these differential equations. For the sake of simplicity, 
we consider 2-DOF motion stage of the system, which considers the process 
of cell injection in the xy plane only. The dynamics of the cell injection sys- 
tem, that is, Eq. (2), is formalized in HOL Light as follows: 

Definition 5.5. Dynamics of the 2-DOF motion stage 
Foes VMX my mp x y t taux tauy fexd feyd. 

dynamics_2dof_motion_stage mx my mp x y t taux tauy fexd feyd = 

mass_matrix mx my mp ** sec_order_deriv_stage_coordin x y t + 





posit_table_matrix ** fir_order_deriv_stage_coordin x y t = 





torque_vector taux tauy - desired_force_vector fexd feyd 
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where mass_matrix is the matrix containing the respective masses. The 
function sec_order_deriv_stage_coordin models the first-order derivative 





of the stage coordinates. Similarly, the function posit_table_matrix pro- 
vides the diagonal matrix. The function sec_order_deriv_stage_coordin 





captures the second-order derivative of the stage coordinates. Similarly, 
the functions torque_vector and desired_force_vector present the vectors 
with their elements representing the x and y components of the applied tor- 
que and desired force, respectively. 

Under the condition of the applied torque and force vectors equal to 
zero, the injection pipette does not touch the cells. Thus, the dynamics 
of the underlying system, that is, Eq. (2), is transformed as follows: 


ax dx 
Mx + My + My 0 “dt. 1 O} |) & 0 
+ — 
0 ara d’y 0 1] | 4 0 ®) 
“dt. dt 


The solution of the dynamics of the motion stage of the cell injection system, 
that is, Eq. (8), is verified as 

Theorem 5.4. Verification of solution of dynamics of motion stage 
Ftnm VX y mx my mp taux tauy fexd feyd alpha xo yo xdo ydo. 


[Al]: 0 < mx A [A2]: 0 < my A [A3]: 0 < mp A 

[A4]: x(0) = x0 A [A5]: y(0) = yOA [A6]: 9X (9)= xd0 A 
. WY yy _ [taux] [0 _ [fexd] _ fo 

[A7]: g¢e(O)= ydd A [A8]: peer A [A9]: ale lal A 


[Alo]: (Vv t. x(t) = (xO + xdoO * (mx + my + mp))) 
=i 
- xdd0 * (mx + my + mp) * emxtmy+mp* 
=1 
[All]: (Wt. y(t) =(y0+yd0 * (my +mp)) - yd * (my +mp) * emy+mp* ) 
=> dynamics_2dof_motion_stage mx my mp x y t taux tauy fexd feyd 


Assumptions A1-A3 present the nonnegativity of the masses mx, my, and mp, 
respectively. Assumptions A4-A7 model the initial conditions, that is, the values of 





the stage coordinates x and y and their first-order derivatives x and ¥ att = 0. 
Assumptions A8-A9 provide the condition that the torque and the force vectors are Zero. 
Assumptions A10-A11 capture the values of the xy stage coordinates at any time t. 
Finally, the conclusion provides the dynamical behavior of the 2-DOF motion stage 
of the underlying system. The verification of Theorem 5.4 involves the properties of 
derivatives of the real-valued functions, transcendental functions, vectors, and matrices 
along with some arithmetic reasoning. We verify an alternate form of the image-stage 
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coordinate frame interrelationship, which depends on the dynamical behavior of the 
motion stage (Definition 5.5) and is characterized as a vital property for the analyzing 
the robotic cell injection systems. For this purpose, we need to model the positioning 
table and inertia matrices: 

Definition 5.6. Positioning table and inertia matrices 
der WEx fy ot. posit_table_matrix_fin fx fy a = 

posit_table_matrix ** matrix_inv (transform_matrix fx fy a) 
F ger Vx my mp fx fy o. inertia_matrix mx my mp fx fy @ = 
mass_matrix mx my mp ** matrix_inv (transform_matrix fx fy a) 

where the function matrix_inv takes a matrix A:RN™ and returns its 
inverse. Now, the alternate representation of the relationship of the image 
and the stage coordinate frames is verified in HOL Light as the following 
theorem: 

Theorem 5.5. Image-stage coordinates interrelationship 
Finm VXC yc uv xX y fx fy dx dy mx my mp taux tauy fexd feyd a. 
[At]: 0 < dx A [A2]: 0 < dy A [A3]: 0 < fx A [A4]: 0 << fy A 
[A5]: invertible (transform_matrix fx fy a) A 
[A6]: (Vt. u real_differentiable atreal t) A 
[A7]: (Vt. v real_differentiable atreal t) A 


[A8]: (Vt. $2 real differentiable atreal t) A 


[AQ]: (Vt. WY real differentiable atreal t) A 





[A10]: (Vt. relat_image_camera_coordin xc yc uv t fx fy) A 








[Al1]: (Vt. relat_camera_stage_coordin xc yc xX y a dx dy t) A 
[A12]: dynamics_2dof_motion_stage mx my mp x y t taux tauy fexd feyd 
=> inertia_matrix mx my mp fx fy a *x 


second_order_deriv_image_coordin uv t + 





posit_table_matrix_finfxfya ** first_order_deriv_image_coordinuvt= 





torque_vector taux tauy - desired_force_vector fexd feyd 
Assumptions A1-A4 provide the design constraints for the image-stage coordinate 
frame interrelationship. Assumption A5 presents the condition about the existence of 
the inverse of the transformation matrix, that is, (transform_matrix, Definition 
5.4) is invertible. Assumptions A6-A9 describe the differentiability condition for the 
image coordinates and their first-order derivatives. Assumptions A10-A11 model the 
image-camera and camera-stage coordinate frame interrelationships, respectively. 
Assumption A12 presents the dynamical behavior of the 2-DOF motion stage of 
the system. Finally, the conclusion of Theorem 5.5 provides the alternate form the 
relationship between the image and stage coordinate frames. The proof process of 
Theorem 5.5 is mainly based on the properties of the derivatives of the real-valued 
functions, vectors, and matrices along with some real arithmetic reasoning. 
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5.2 Formalization of the motion planning of the injection 
pipette 

The motion of the injection pipette is vital for the process of the robotic cell 
injection as a slight excessive force applied on the pipette may damage the 
membrane of the cell or an insufficient force may not be able to pierce 
the cell. The motion of the pipette is generally controlled by the force 
and the torque controllers, which are mainly responsible for controlling 
the applied injection force and the torque applied to the deriving motor. 
We formalize both these controllers and formally verify their implication 
relationship. The impendence force control for a robotic cell injection sys- 
tem is mathematically expressed as 


me + be + ke= f, (9) 


where m, b, and k represent the desired impendence parameters. Similarly, f, 
is the two-dimensional vector containing the x and y components of the 
applied force. Moreover, e, é, and é are the two-dimensional vectors captur- 
ing the position errors of the xy motion stage coordinate frame, its first-order 
and second-order derivatives, respectively, and are given as follows: 


dxq dx xy ix 
=|* ae dye] Jay |? ©] ey} | ey} © 
dt dt dt dt 


where x and y are the actual axes and x, and y, are the desired axes of the 
stage coordinate frame. Now, the image-based torque controller for the xy 
stage coordinates is mathematically expressed as 


xg 
Tx My + my + Mp 0 frcosa f,sina dt 
ey! 0 m,+m,|l—fysina f,cosa} | d7yq 
dt 


i my + my + Mp 0 frcosa f,sina 
0 my, + my | | —fysina f,cosa 


-“l(pe+h + 1 O1[ fecosa f.sina]~' (11) 
xm_'(be + ke—f.) A i Eee sees 


dx 


‘ f.cosa f.sina| | ay dy fex! 
—f,sina f,cosa} | dy 
dt 
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Eq. (11) can be written in a compact form as 


ax4 dx 
t=MT by, + MTm~'(be + ke—f.) + NT 4 + fei (12) 
at dt 


where 7 and a describe the torque and desired force vectors. Similarly, M, 
N, and T model the inertia, positioning table, and transformation matrices. 
Eq. (12) was wrongly presented in simulation-based analysis (Huang et al., 
2006) as follows: 


xq dx 
Z=M| ff | +Mn'(betke—f)+N] aT fe (13) 
rs dt 


In Eq. (13) (used in the simulation-based analysis; Huang et al., 2006), the 
transformation matrix (T) is missing, which involves the contributions of 
the applied force and the angle at which the injection pipette is pierced into 
the cell and its absence can lead to disastrous consequences, that is, excess 
substance injection, injection of the substance at the wrong location, cell tis- 
sues damage, etc. We caught this wrong interpretation of Eq. (12) in the 
simulation-based analysis during the verification of the implication relation- 
ship between the force and torque controllers. We verified the implication 
relationship between the impendence force control and the image-based 
torque controller (Eq. 12) in HOL Light as follows: 

Theorem 5.6. Relationship between force and torque controllers 
Ftnm VXd yd x y t mx my mp fx fy aw taux tauy fex fey fexd feyd mb k. 

[Al]: 0 < mA [A2]: 0 < k A [A3]: 0< DA 

[A4]: invertible (transform_matrix fx fy a) A 

[A5]: force_controller xd yd x y t mb k fex fey A 

[A6]: dynamics_2dof_motion_stage mx my mp x y t taux tauy fexd feyd 

= torque_controller xd yd x y t mx my mp fx fy 








a taux tauy fex fey fexd feyd mb k 
Assumptions M1-A3 model the nonnegativity of the desired impendence parame- 
ters. Assumption A4 presents the existence of the inverse of the transformation matrix. 
Assumption A5 provides the impendence force controller (Eq. 9). Similarly, Assump- 
tion A6 describes the dynamical behavior of the 2-DOF motion stage. Finally, the 
conclusion provides the image-based torque controller (Eq. 11). The proof process 
of Theorem 5.6 is mainly based on the properties of derivatives of the real-valued 
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functions, matrices, and vectors. This concludes our formalization of the motion plan- 
ning of the injection pipette used in the process of the robotic cell injection. 





6 Discussions 


The probabilistic model checking-based formalization of the robotic 
cell injection systems using PRISM, presented earlier, is based on DIMC 
and thus involves the discretization of the continuous dynamics (modeling 
differential equations) of these systems. Moreover, due to the assignment 
of probabilities to transitions of the state-based PRISM model, it incorpo- 
rates various disturbances and measurement noises associated with the 
underlying system. However, the proposed framework only involves 
the development of the formal model and thus it lacks the property veri- 
fication corresponding to this model, which can be done automatically. 
Moreover, it enables the formalization of 2-DOF cell injection system 
and cannot be used to reason about 3-DOF and 4-DOF robotic injection 
system. 

In comparison to the model checking-based analysis, the higher-order- 
logic theorem proving-based approach allows us to model the dynamics of 
the cell injection systems involving differential and derivative (Eqs. 2, 9, 11) 
in their true form, whereas, in their model checking-based analysis (Sardar 
and Hasan, 2017), they are discretized and modeled using a state-transition 
system. Moreover, all the verified theorems are universally quantified and 
can thus be specialized to the required values based on the requirement 
of the analysis of the cell injection systems. However, due to the undecidable 
nature of the higher-order logic, the verification results involve manual 
interventions and human guidance. Moreover, it only provides the formal- 
ization of 2-DOF cell injection system and cannot be used to reason about 
3-DOF and 4-DOF robotic injection system. Table 3 presents a comparison 
of various analysis techniques, summarizing their strength and weaknesses, 
for analyzing the robotic cell injection systems. This comparison is per- 
formed based on various parameters such as expressiveness, accuracy, and 
automation. For example, in model checking, we cannot truly model the 
differential equations, and their discretization results in an abstracted model, 
which makes it less expressive. Moreover, higher-order-logic theorem 
proving enables the verification in an interactive manner due to the 
undecidable nature of the underlying logic. 
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Table 3 Comparison of techniques for analyzing robotic cell injection systems. 











Paper-and- Computer 
pencil algebra Model Theorem 
proof Simulation = system checking proving 
Expressiveness v v v v 
Accuracy v (2) v v 
Automation v v v 








7 Conclusions 


Robotic cell injection involves the insertion of bimolecules, sperms, 
DNA, and proteins into a specific location of suspended or adherent cells and 
is widely used in drug development, cellular biology research, and trans- 
genics. This chapter provides our probabilistic model checking and 
higher-order-logic theorem proving-based formalization of the 2-DOF 
robotic cell injection systems. Finally, a discussion provides the strengths 
and weaknesses of these analyses and thus enables a user to select the appro- 
priate analysis technique based on a particular scenario. 
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1 Introduction 


Microscopic devices small enough to pass through the circulatory sys- 
tem are useful for biological research and medicine (Freitas, 1999; Martel, 
2007; Monroe, 2009; Hill et al., 2008; Schulz et al., 2009). For instance, 
nanoparticles can precisely deliver drugs (Allen and Cullis, 2004). More 
elaborate applications could arise from devices with a full range of robotic 
capabilities, including sensing, computation, communication, and locomo- 
tion. These microscopic robots could sense a variety of signals, including 
chemicals on cells (Park et al., 2008), fluid shear (Korin et al., 2012), light, 
or temperature (Sershen et al., 2000). 

Applications of microscopic robots could improve their precision if 
robots can identify type of tissue they are passing through. For circulating 
robots in the vasculature, especially useful identification methods are those 
available to the robot from properties measurable from within the vessels. 
For instance, the geometry of capillaries differs among organs (Augustin 
and Koh, 2017) and between normal and tumor vasculature (Nagy et al., 
2009; Jain et al., 2014). Thus, robots able to determine vessel geometry 
could supplement other available information, such as chemicals, to more 
accurately identify different types of tissue. 

An important aspect of vessel geometry is when a vessel splits into bra- 
nches, or when several vessels merge into a larger one. Microscopic robots 
might detect branches acoustically (Freitas, 1999), although interpreting 
reflected signals could require significant computation in the presence of 
multiple reflections, scattering, and the small difference in acoustic imped- 
ance between the fluid and walls of tiny vessels. As a complementary 


Control Systems Design of Bio-Robotics and Bio-mechatronics 171 
with advanced applications © 2020 Elsevier Inc. 
https://doi.org/10.1016/B978-0-12-817463-0.00006-X All rights reserved. 


172 Tad Hogg 





approach, this chapter describes and evaluates how robots could detect bra- 
nches from changes in the patterns of fluid-induced stresses on their surfaces. 

Specifically, this chapter first summarizes related work in microscopic 
devices. Then, the following two sections describe typical geometric param- 
eters of tiny vessels and the stresses on the surface of an object moving with 
the fluid in such vessels. The next two sections show how a robot can use 
stress measurements to identify when it is passing vessel branches. Section 7 
evaluates the performance of this approach. The remaining sections discuss 
possible extensions to more complicated scenarios. The “Appendix” section 
describes the scenarios used for training and testing, and the resulting the 
classifier used to identify branches. 





2 Related work 


Some existing devices (Koman et al., 2018; Jager et al., 2000; Martel 
et al., 2007; Sitti et al., 2015) demonstrate various robotic capabilities in 
small volumes, although they are generally too large to fit through capillaries. 
Smaller demonstrated devices include DNA nanodevices (Ke et al., 2018; Li 
et al., 2018; Thubagere et al., 2017), biohybrids with bacteria (Martel, 
2014), and sequential logic within cells (Andrews et al., 2018), with more 
limited sensing and computational capabilities than larger counterparts. 
Building on these demonstrations, future microscopic robots could provide 
a wide range of capabilities in a volume small enough to pass through cap- 
illaries (Freitas, 1999). 

For navigation, fluid stresses provide useful information at larger scales, 
for example, for fish (Bleckmann and Zelick, 2009) and underwater vehicles 
(Yang et al., 2006; Vollmayr et al., 2014). Micromachine sensors motivated 
by those of fish can detect relatively small changes in fluid motion (Kottapalli 
et al., 2014). These fluid stresses provide information about the environment 
within about a body length of the object in the fluid (Sichert et al., 2009), 
although extracting this information requires significant computation 
(Bouffanais et al., 2010). Another example of sensing fluid motion is the 
use of artificial whiskers, modeled on the geometry of seal whiskers, to esti- 
mate the direction, size, and speed of moving objects from their wakes 
(Eberhardt, 2016). 

For microscopic objects in fluids, viscous rather than inertial forces dom- 
inate the flow (Dusenbery, 2009; Purcell, 1977). Viscous flows have a linear 
relation between stresses and velocities (Happel and Brenner, 1983), 
allowing simpler computations to interpret stresses than required for 
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larger-scale flows. This simplicity enables stress-based navigation by micro- 
scopic robots (Hogg, 2018) in spite of their computational limits, both in 
terms of operating speed and memory. Moreover, viscous flow generally 
has gentle gradients, so the effect of boundaries extends relatively far into 
the fluid. This potentially allows a microscopic robot to use stresses to infer 
properties of the boundaries at larger distances, relative to its size, than is fea- 
sible for larger robots. 





3 The geometry of microscopic vessels 


This chapter examines spherical robots in moving fluids similar to 
water, with parameters given in Table 1. We numerically evaluate robot 
behavior in vessels with geometry comparable to that of short segments 
of capillaries. These vessels generally have radii of curvature of tens of 
microns (Pawlik et al., 1981), and when they split, they typically split into 
just two branches (Cassot, 2006). The branches have a larger total cross- 
section than the main vessel (Murray, 1926), leading to slower flows in 
the branches (Sochi, 2015). 

For simplicity, we focus on planar vessel geometry. Specifically, incom- 
ing and outgoing axes of curved vessels are in the same plane. Similarly, 
branching vessels have the axes of the main vessel and the branches in the 
same plane. 

Fig. 1 shows examples of the vessel geometries considered here. The 
fluid flow speed for these two cases is chosen so the robots have the same 
average stress magnitudes on their surfaces at the indicated position along 
each paths. Specifically, the maximum speed at the inlet is 1000 and 
530 m/s, for the branch and curve, respectively. At the position of the 


Table 1 Typical parameters for fluids and microscopic robots 




















Density p 10° kg/m? 
Viscosity n 10° Pa s 
Kinematic viscosity v=n/p 10° m?/s 
Vessel diameter d 5-10 pm 
Maximum flow speed u 200-2000 [m/s 
Reynolds number Re = ud/v <0.04 





Robot radius r 1 pm 
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-70 ms 





(A) (B) 

Fig. 1 Robot motion through (A) branched and (B) curved vessels. The curved arrow 
shows a portion of the path of the robot's center as it moves through the vessel with 
the fluid. The ticks along the paths indicate times, in milliseconds, before or after the 
location of the robot indicated by the gray disk. The dashed rectangles indicate the parts 
of the vessel shown in Fig. 2. The robot has radius 1 pm and the vessel inlets, to the left 
of the sections shown in the figure, both have diameters of 7.8 1m. 


robot shown in the branch, the robot moves at 189 m/s and rotates with 
angular velocity —34 rad/s, that is, clockwise. For the curve, these values are 
186 pm /s and +39 rad/s. 

For developing and testing a branch classifier based on stresses on the 
robot’s surface, we create samples of robots in branch and curve vessels. 
Appendix A.1 describes the parameters for the vessel geometry, initial robot 
position, and fluid flow speed used to create these samples. These vessels are 
similar in size to the examples of Fig. 1. 





4 Robot stresses and motion in vessels 


We determine stresses on the robot surface by numerically evaluating 
the flow and robot motion in a segment of the vessel. For the vessel sizes, 
planar geometries and fluid speeds considered here, the motion and stresses 
can be approximated by two-dimensional quasistatic Stokes flow (Hogg, 
2018). As examples, Fig. 2 shows the fluid velocity near the robot, in the 
section of the vessel indicated by the dashed rectangles in Fig. 1. In spite 
of the different vessel geometries, the flow near the robot is similar in the 
two cases. 
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Fig. 2 Fluid flow near the robot for the scenarios shown in Fig. 1. Arrows show stream- 
lines of the flow and colors show the flow speed. (A) Fluid velocity in the branch with 
respect to the vessel. Velocity is zero at the vessel wall, and matches the motion of the 
robot at its surface. (B) Fluid velocity in the branch with respect to the robot. Velocity is 
zero at the robot surface. (C) Fluid velocity in the curve with respect to the vessel. 
(D) Fluid velocity in the curve with respect to the robot. The legend at the bottom of 
each column applies to the two plots above it. 


4.1 Stresses on robot surface 

We denote the stresses on a robot’s surface by s(@, f) for the stress vector at 
angle @ at time ft. The angle @ specifies a location on a robot’s surface, mea- 
sured from an arbitrary fixed point on the robot called its “front,” as 
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5 


Fig. 3 A robot, indicated as a gray disk, with n = 30 stress sensors, shown as points, 
spaced uniformly around its surface. The green line (gray line in print version) indicates 
the front of the robot. 


illustrated in Fig. 3. A robot can estimate s(0, ft) by measuring stresses at var- 
ious locations on its surface with force sensors, and interpolating between 
these locations. By measuring forces normal and tangential to the surface, 
the sensors determine the stress vector (Hogg, 2018). 

The stresses depend on the vessel geometry near the robot and the speed 
of the flow. However, this relationship is not unique: different geometries 
can produce similar stress patterns. Fig. 1 provides one such example. In 
these cases, Fig. 4 shows how stresses vary over the robot’s surface, with 
the arrows indicating the stress vectors at points spaced uniformly around 
the surface. The patterns of stress on the surfaces are nearly the same. Thus, 





Branch 





Fig. 4 Stress vectors on the robot surface for the indicated robot positions in the branch 
and curve scenarios of Fig. 1. The arrow lengths show the magnitude of the stresses, 
ranging up to 0.58 Pa, at locations of sensors on the robot surface. 
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in general, the pattern of stresses at a single instant does not reliably identify 
the geometry of the vessel near the robot. 


4.2 Changing stress patterns 


Asa robot moves through a vessel with changing geometry, the stresses on its 
surface change. In many cases, the stresses change significantly as a robot 
moves through a branch, whereas changes are fairly small as a robot moves 
around a curve. 

One measure of changing stresses is the correlation of the stress pattern at 
two times. Suppose £(@) and g(@) are two vector-valued functions of the 


angle @ around the robot’s surface. The correlation between these vector 
fields is 


1 2a 
r(f, g) =—__—. £(0) -g(@)d0 1 
cote) gpg |, *O-€ . 





with the norm ||f|| = VRE) -£(0)d0 and f -g denoting the inner prod- 
uct of the two vectors. 

In our case, the vector fields are the stresses on the robot surface. As an 
example, the correlation between the surface stresses in the two cases shown 
in Fig. 4 is 0.98. Due to the normalization, the correlation is independent of 
the overall magnitude of the stresses. In particular, this means that the cor- 
relation does not depend on the fluid viscosity. 

As noted earlier, the robot can estimate the stress field s(0, £) by interpo- 
lating surface stress measurements. A particularly useful method is interpo- 
lating the stress pattern from a few Fourier modes. The correlation between 
two stress patterns can be computed directly from the Fourier coefficients, 
avoiding the need to explicitly evaluate the integrals in Eq. (1) (Hogg, 2018). 
Specifically, we use the first six modes, which capture most of the variation 
in stress over the robot’s surface for the cases considered here. 

When viewed from a fixed location on the robot surface, for example, a 
specific sensor, the stress changes both due to changing vessel geometry and 
due to the robot’s rotation caused by the fluid. This rotation is not relevant 
for identifying vessel geometry for the spherical robots considered here. 
Thus, to identify changes in geometry, the robot must remove the change 
due to its rotation. A simple way to do so is to maximize the correlation over 
all possible rotations of the robot between the two measurements used in the 
correlation. Specifically, this approach compares the stress at time f, s(, #), 
with shifted versions of the stress at a prior time, s(@ + A@, t —A?), and uses 
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the maximum correlation over all shifts A@. That is, the robot measures 
changes in the pattern of stress that are not due to its rotation by evaluating 


eiAt) = max cor(s(0,t),s(@ + A@, t— At)) (2) 


for the correlation function of Eq. (1). Another application of this maximi- 
zation is estimating the robot’s angular velocity because the shift in angle, 
AO, giving the maximum is an estimate of how much the robot has rotated 
between these two times (Hogg, 2018). 

As an example, Fig. 5 shows the correlation between stress patterns sep- 
arated by 10 ms as the robot moves through the branch and curved vessels of 
Fig. 1. For the curve, the stress pattern remains nearly the same, so correla- 
tions are close to one. For the branch, however, the correlation drops as the 
robot approaches the branch, about 30 ms before it reaches the position 
shown in Fig. 1. Later, the correlation drops again as the robot moves into 
one of the branches. Similarly, ifthe robot was moving in the opposite direc- 
tion, that is, the flow was a merge of two small vessels into a larger one, the 
robot would encounter these drops in correlation in the opposite order and 
at times shifted by 10 ms as it compares its current stress pattern with the 
pattern it had encountered earlier along the reversed path. 

For the flow speeds and vessel sizes considered here, At = 10 ms is a rea- 
sonable choice: over that time a robot can move a distance comparable to the 


Correlation of stress patterns as robot moves 
1.00; 


eee 


- 28 


0.98} 


0.96} 


0.94} 





Correlation over 10 ms 


Branch 
0.92}- 











—40 —20 0 20 40 

Time (ms) 
Fig.5 Correlation c(t, At) between stress patterns at times t and t —At, with At = 10 ms, 
as the robot moves along the paths shown in Fig. 1. The times correspond to the tick 
marks along the paths shown in Fig. 1, with t = 0 corresponding to the robot positions 
shown in that figure. 
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extent of branching or curving, but not so far as to completely pass the 
changing geometry. However, the precise value of Af is not important. 
For example, comparing stresses separated by At = 5 or 20 ms is qualitatively 
similar to the behavior shown in Fig. 5. For definiteness, we use Af = 10 ms 
in the following discussion. 





5 Classifying vessel geometry 


Fig. 5 suggests a robot could identify vessel branches by checking for 
when the correlation of stresses separated by a short time is sufficiently small. 
This procedure could reliably distinguish branches from curves if there is 
little overlap in the distributions of minimum correlations for these two 
geometries. Unfortunately, the behavior shown in Fig. 5 does not occur 
in all cases. Instead, the distributions of minimum correlation for curves 
and branches have considerable overlap, especially when the robot is near 
the center of the vessel. 

Fig. 6 quantifies this difficulty by showing how the minimum correlation 
along a path depends on how close the robot is to the vessel wall before it 
reaches the curve or branch, that is, while still in a fairly straight portion of 
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Fig. 6 Scatterplot of the minimum value of c(t, At) along a path, for At = 10 ms, and 
initial relative position, defined by Eq. (3). The points distinguish robots moving through 
a branch, around a curve, or in a straight vessel. To highlight the differences among 
these geometries, the horizontal axis shows 1 — c ona logarithmic scale. Thus, situations 
where the stress pattern changes only slightly over time At, that is, correlations are close 
to 1, appear on the left side of the diagram. 
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Center of vessel 








Fig. 7 Position of robot (gray disk) in a straight segment of a vessel, used to define the 
robot's relative position. 


the vessel. As a measure of how close a robot is to the vessel wall, we use the 
robot’s relative position, given by 


_ lye| 
ar ae (3) 


where y, is the position of the robot’s center relative to the central axis of the 
vessel, d is the vessel diameter, and r is the robot’s radius, as illustrated in 
Fig. 7. Relative position ranges from 0, for a robot at the center of the vessel, 
to 1, for a robot just touching the vessel wall. A robot can accurately estimate 
its relative position while in a straight vessel segment from surface stresses 
(Hogg, 2018). 

When the robot starts near the center of the vessel, Fig. 6 shows that 
curved paths have a wider range of minimum correlations than branches, 
and this range includes the values occurring in branches. Combined with 
smaller, and hence noisier, stresses for robots relatively far from the vessel 
wall (Hogg, 2018), this indicates correlation is not a reliable identifier of bra- 
nches when robots start near the vessel center. 

To improve identification for paths starting close to vessel center, a third 
piece of information is helpful, namely a summary of the stress pattern at the 
time the robot evaluates the correlation. That is, to identify branches, at time 
t, we use three pieces of information: the correlation c(t, Ad), the relative 
position for the path that was determined prior to any significant change 
in the stress, and the current stress s(0, 1). 

To create a vessel geometry classifier using this information, we generate 
a set of training samples. Specifically, for each training sample (created as 
described in Appendix A.1), we determine the time ¢ along the path with 


Identifying vessel branching from fluid stresses on microscopic robots 181 





the minimum correlation, and use the three pieces of information from that 
time along the path. This method is an example of off-line training. That is, 
we suppose the training samples have measurements from a completed path, 
that is, a path starting before the robot reaches the branch or curve, and con- 
tinuing until the robot 1s well past those changes. With measurements along 
the whole path, the time of minimum correlation can be obtained and values 
at that time used for training. Using such training samples from both branch 
and curve vessels results in the logistic regression classifier for branches 
described in Appendix B.2. 





6 Applying the classifier to identify branches 


The classifier described earlier was trained with the minimum corre- 
lation along a path. A robot using the same method when applying the clas- 
sifier would have to wait until it was sufficiently far past a changing geometry 
to be sure it had detected the minimum correlation along the path for that 
change. This off-line application of the classifier could be useful in reporting 
vessel geometry changes well after encountering them, for example, to pro- 
vide a description of the path leading the robot to a target location. 

We focus on the more demanding classification task of recognizing a 
branch near the time the robot encounters it. This online or real-time clas- 
sification allows the robot to take action, while still near the branch. In this 
case, a robot uses the classifier by repeatedly evaluating Eq. (B.1) as it moves. 
During these evaluations, the correlation c(t, Af) is not necessarily the min- 
imum correlation along the path: that is, the robot could encounter smaller 
values as it continues through the vessel. Thus, the robot using this method is 
extrapolating beyond the values used for training. 

The classifier uses the robot’s relative position in the vessel before it 
encounters a branch or significant curve. Thus, the robot must save its esti- 
mate of relative position, updating the value only while vessel geometry is 
not changing. A robot could determine when this steady behavior occurs by 
checking when the correlations between stresses at various delay times Atare 
close to 1, and the pattern of stress on its surface is consistent with its presence 
in a straight vessel segment (Hogg, 2018). When the robot encounters 
changing geometry, it uses the saved estimate of its relative position when 
evaluating the classifier, that is, Eq. (B.1). This procedure applies to typical 
capillaries (Pawlik et al., 1981) where significant geometry changes are sep- 
arated by tens of microns, a considerably larger distance than the size of the 
robots small enough to pass through those vessels. 


182 Tad Hogg 





6.1 Example 


As an example of how the classifier applies to online classification, Fig. 8 
shows the estimates of Pyranch from Eq. (B.1) along the robot paths of 
Fig. 1. The branch path has higher values than the curve. This example indi- 
cates how a robot could use the classifier for online branch identification: 
consider a branch to be nearby whenever Pyranch exceeds a predetermined 
threshold. For this example, a threshold around 0.8 distinguishes the branch 
from the curve. 

In addition to identifying whether the robot passes a branch, Fig. 8 indi- 
cates when this method detects the branch. In this case for the branching ves- 
sel, Pyranch becomes large about 30 ms before the robot reaches the location 
shown in Fig. 1. This corresponds to the robot entering the branch. The 
robot slows as it moves through the branch, leading to a period of large cor- 
relation for about 20 ms. As the robot leaves the branch, the stress pattern 
changes again, leading to a second minimum in the correlation (see 
Fig. 5) and another maximum in Pyyanch- In other cases, the robot moves 
more rapidly through the branch, so the At = 10 ms time difference used 
here gives a single minimum in the correlation and, correspondingly, a single 
peak in Pyranch- A robot could distinguish these cases by checking for a sec- 
ond peak within a few tens of milliseconds. Over that amount of time, the 
second peak indicates the robot is leaving the branch rather than encounter- 
ing a second branch. This is consistent with the typical spacing of branches in 
capillaries (see Section 3). 
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Fig. 8 Estimated probability of encountering a branch, Ppranch, VS. time as the robot 
moves along the paths shown in Fig. 1, based on correlation c(t, At) with At = 10 ms. 
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6.2 Selecting a threshold to identify branches 


A suitable threshold to use for identifying branches with this classifier 
depends on the relative importance of false negatives (i.e., missing a branch) 
and false positives (i.e., incorrectly considering a curved vessel to have a 
branch). The importance of these errors depends on the application. 

For example, if a robot with locomotion capability needs to move into a 
branch, it is better to recognize a branch before passing it, so the robot would 
only need to actively move a short distance to reach the desired branch. This 
contrasts with the situation of not recognizing the branch until well after the 
robot has passed it, in which case it would need a more larger distance and 
upstream against the flow of the fluid. In this case, the robot could use a rel- 
atively low threshold, thereby being fairly sure it will identify branches as it 
encounters them, although it may also, incorrectly, attempt to move into a 
branch when passing through some curved vessels. Such errors are more 
likely the earlier the robot needs to identify a branch because the flow well 
upstream of a branch is similar to that in vessel without branch. 

Another action the robot could take upon detecting a branch is to move 
to the vessel wall near the branch and act as a beacon to other robots arriving 
at the branch. The beacon signal could, for example, direct subsequent 
robots into one branch or the other to ensure roughly equal numbers 
explore each branch in spite of the fluid flow favoring one branch over 
the other. More generally, branches could be useful locations to station 
robots for forming a navigation network (Freitas, 1999). With a limited 
number of robots to form this network and if it is sufficient to station robots 
at some rather than all branches, the robot could use a high threshold to 
ensure identified branches are very likely to actually be branches. 

Other applications have less need for identifying branches, while robots 
are close to them, but instead collect information on the number and spacing 
of branches for later use, for example, as a map or diagnostic tool at larger 
scales than short segments ofa single vessel. This applies to identifying vessel 
geometries that distinguish different organs or normal from cancer tissue 
(Nagy et al., 2009; Jain et al., 2014). In such cases, the emphasis could be 
on identifying all branches, favoring a relatively low threshold, and then ver- 
ifying detected branches with subsequent measurements after the robot has 
moved past each possible branch, thereby reducing the false positives while 
keeping sensor information obtained near the branches from the original 
identification of those cases later verified to be branches. 

Multiple robots spaced closely enough could communicate verified 
branch detections to robots upstream of the branch. With a message from 
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a downstream robot that it verified its recent passage of a branch, a robot 
could lower its threshold in anticipation of that upcoming branch. The mes- 
sage could come from a downstream robot that entered a different branch of 
the splitting vessel than the robot receiving the message. For example, with 
acoustic communication robots could compare measurements over 100 pm 
or so (Hogg and Freitas, 2012), which is farther than the typical spacing 
between branches in capillaries described in Section 3. 


6.3 Verification after passing a curve or branch 


This chapter describes how a robot can use stresses to identify branches as it 
encounters them. This contrasts with off-line methods that collect time- 
stamped information before, during, and after a robot passes a branch, 
and later use the entire path history to identify if and when the robot passed 
branches. A possible combination of the two approaches is to use online clas- 
sification to identify likely branches, record information about them, and 
later verify the branch detection when the robot has additional information 
after passing the possible branch. 

Information a robot could use for this verification task includes changes 
in vessel diameter, relative position, and robot speed before and after passing 
the curve or branch. Typically, these changes are much larger after passing a 
branch than a curve. Such comparisons must wait until the robot is well past 
the branch or curve, when it is again in a nearly straight vessel segment, 
where  stress-based navigation allows estimating these quantities 
(Hogg, 2018). 

Specifically, when a vessel splits into branches, the branches have smaller 
diameter than the main vessel, but the combined cross-sections of the bra- 
nches is larger than that of the main vessel (Murray, 1926). Thus, measuring 
vessel diameter before and after the branch gives a direct indication of 
branching. 

The increased cross-sectional area after a vessel splits leads to slower flows 
in the branches (Sochi, 2015), whereas flow in a curve remains nearly con- 
stant. This suggests a robot could check for changes in its speed through the 
vessel before and after passing a branch or curve to verify the identification. 
However, slower fluid speed in the branch does not necessarily mean the 
robot’s speed changes in the same proportion, because the robot’s speed 
depends both on the speed of the flow and how close the robot is to the wall, 
that is, its relative position. Along with flow speed, the relative position can 
change as a robot passes a branch. 


Identifying vessel branching from fluid stresses on microscopic robots 185 


y ie 20 MS 10 ms 
== 
10 /an ae 









berohirsapa, 


. 100 ms 0 ms20 ms 40 ms 2 oo nits 








60 ms oe * 
0 eon. 0 ms 
Ole 2 Oe ms 2 
rer tee 7 ms g ‘0 ms 
Ogle camenunannaeates 2, 
aie ' ' Pane room fame 


(B) 


. 9 Robot paths through (A) branched and (B) curved vessels. Each path is for a robot 
traveling by itself through the vessel with the fluid. The ticks along the paths indicate 
times, in milliseconds, from the start of each path when the maximum inlet flow speed 
is 1000 jm/s. Robots along paths near the center of the vessel move more rapidly than 
those near the walls, indicated by the wider spacing between successive ticks along the 
central paths. The vessel inlets both have diameters of 7.8 ym. 


Fig. 9 illustrates this behavior. Robots close to the wall remain close 
upon entering a branch or moving around a curve. But robots entering a 
branch near the center of the vessel move to near the wall of the branch, 
and robots starting between the center and the wall move to near the middle 
ofa branch. This change in relative position can distinguish branching from 
curved paths that are not close to the wall. Similarly, the change in speed is 
particularly large for branch paths when the robot is not near the wall, so its 
speed reflects the decreasing flow through the branches. When the robot is 
near the wall, in either a branch or curve, it moves relatively slowly and 
remains near the wall, giving relatively little change. By contrast, Fig. 10 
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Fig. 10 Correlation c(t, At) between stress patterns at times t and t —At, with At = 
10 ms, as the robot moves along the (A) branched and (B) curved paths shown in 
Fig. 9. The times correspond to the tick marks along the paths. In each case, the path 
near the center of the vessel has the largest decrease in correlation. 
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shows that the minimum correlation of the stress patterns does not, by itself, 
distinguish these paths. In particular, paths close to the center of the vessels 
have small minimums. In this case, the curve has a smaller minimum than 
that of the branch, corresponding to the points at the lower right of Fig. 6. 

Changes in relative position and speed are particularly useful for dis- 
tinguishing curves and branches for paths near the middle of the vessels, pre- 
cisely the cases where the correlation-based method in this chapter is least 
reliable (see Fig. 6). Moreover, the larger differences in these measures between 
curves and branches for paths near the center of the vessel could compensate to 
some extent for the lower accuracy of estimating position and speed from 
stresses when the robot is near the center of the vessel (Hogg, 2018). 

Due to errors in estimating position, speed, and vessel diameter from 
stresses (Hogg, 2018), evaluating changes from a combination of these mea- 
sures before and after passing a branch or curve is likely to be more robust 
than relying on a single method. 





7 Classification performance 


This section evaluates how the classifier performs using a set of test 
samples. 

In the branch vessels considered here, the fluid flows from the larger ves- 
sel into the two branches. Thus, testing the classifier with these paths eval- 
uates how well a robot recognizes when the vessel splits into two smaller 
vessels, with the robot moving into one of them. The situation for flow 
merging from smaller branches into a larger vessel is similar. This is because 
for a robot at a given location in a vessel, stresses on the robot surface are the 
same for either direction of the flow due to the reversibility of Stokes flow 
(Happel and Brenner, 1983). Thus, the stress measurements along a path are 
the same for paths through merging branches, but in the reverse order. 

For merging vessels, the classification operates in the same way as for 
splitting vessels, but with a shift of ttme Atin when the correlation is mea- 
sured. For instance, for the robot at the location shown in Fig. 1A, the cor- 
relation c(t, Af) compares the stresses at the robot’s indicated location with 
the stresses when the robot’s center was at the point along the path indicated 
by the tick for —10 ms when using Af = 10 ms. Conversely, a robot moving 
in the reverse direction along the path, that is, from the branch at the upper 
right into the main vessel at the left, would compare its stress with that 10 ms 
earlier on the reverse path, corresponding to the location of the tick for 
10 ms on the forward path. Thus while stresses are the same along the 
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forward and reversed paths, the comparison used for the correlation and the 
initial position in the vessel before encountering the branch are different for 
these two directions. 

When the robot along the reverse path is at the position indicated by the 
tick for —10 ms, it would compare stresses at the same two times that the 
robot on the forward path does at the position indicated in the figure. So, 
a robot on the reverse path computes the same correlations as a robot on 
the forward path, but with a shift of At in time. In this comparison, the 
robots use the same correlation in the classifier. But because they are at dif- 
ferent locations along the path when they evaluate that correlation, they 
would have different values for the other two values used in the classifier: 
the current stress and the initial relative position. 

The classifier training only included the forward direction for each 
branch, that is, moving from a main vessel into one of the branches at a split. 
Asa test of how well the classifier generalizes, we use both path directions for 
each branch test sample. 


7.1 Accuracy 


Since the choice of threshold depends on the application, instead of charac- 
terizing a classifier for a single choice of threshold, a better measure is the 
trade-off between true and false positives over the range of threshold values. 
At one extreme, a threshold equal to one means the robot never recognizes a 
branch (no true positives) but also never mistakenly considers a curve to be a 
branch (no false positives). At the other extreme, a threshold equal to zero 
means the robot always considers itself to be encountering branches: this 
identifies all actual branches, but also mistakenly recognizes curves and 
straight vessel segments as branches (high false positives). For a perfect clas- 
sifier, there would exist an intermediate threshold allowing it to identify all 
branches without also mistaking other geometries for branches. 

For the classifier developed in this chapter, Fig. 11 shows the perfor- 
mance as the threshold varies from 1 (at lower left) to 0 (at upper right). Spe- 
cifically, for each threshold value, the figure evaluates Pyranch With Eq. (B.1) 
along the path of each test sample. If Pyyanch exceeds the threshold anywhere 
along the path that sample is classified as a branched vessel. The true positives 
are the branch samples identified as branches using that threshold, and the 
false positives are the curve samples incorrectly identified as branches. 

This classifier performs well: with suitable threshold, the classifier recog- 
nizes most branches with only a few mistakes, as indicated by the curve in 
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Fig. 11 Classification performance on test samples. The curve would follow the dashed 
diagonal line if the classifier did not discriminate between paths through branch and 
curve vessels. 


Fig. 11 passing close to the ideal behavior of recognizing all true positives 
and none of the false positives (i.e., the upper-left corner of the figure). This 
trade-off curve includes both forward and reverse paths. Examining perfor- 
mance separately for each direction (i.e., splitting or merging vessels) shows 
similar curves. Thus, there is no penalty for not including reverse paths when 
training the classifier. This is an indication of the robustness of the informa- 
tion used for this classifier, and the simplicity from the reversibility of 
Stokes flow. 

An overall performance measure from the trade-off of Fig. 11 is the area 
under the curve. In this case, the area is 98.6% of the total area. By compar- 
ison, the area would be 50% for a classifier that made no distinction between 
branch and curve, and 100% for a perfect classifier. 


7.2 When branches are identified 


In addition to how accurately this classifier detects branches, an important 
performance measure is where along a path the robot first detects a branch. 
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One of the features this classifier uses is the correlation between stresses at the 
robot’s current location and those at the time At = 10 ms earlier. Typically, 
stresses change the most as the robot passes through the branch, and during 
10 ms the robot does not move significantly past the branch. This means the 
classifier typically detects the branch, while the robot is within the branching 
section of the vessel. 

Quantitatively, Fig. 12 shows this classifier generally identifies branches 
near the middle of the sample paths. This corresponds to when the robot is 
close to the branch, rather than well before or after passing the branch. That 
is, this classifier identifies branches, while the robot is close to them. Thus, a 
robot can use this stress-based classifier to identify when it is passing a branch, 
well before it passes significantly downstream of the branch. On the other 
hand, branches are not identified well before the robot reaches the branch. 
Thus, this classifier is not useful for applications requiring significant advance 
notice that the robot is approaching a branch. 

This classifier can detect most branches (high true positive fraction) with 
only a few false positives (see Fig. 11). Thus, applications will likely use 
thresholds low enough to give true positive fraction above, say, 80% or 
so, corresponding to the right portion of Fig. 12. With this choice for the 
threshold, branch detection will generally occur at smaller fractions of the 
path length for forward paths than for reverse paths. This corresponds to 
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Fig. 12 Fraction of path length of the test sample paths at which Prranch first exceeds 
the detection threshold corresponding to the true positive fraction indicated on the 
horizontal axis. The solid and dashed curves are for forward and reverse branch paths, 
respectively. Error bars show the standard error of the means, indicated by the points. 
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a robot moving toward a vessel split detecting the branch just as the main 
vessel splits. Conversely, a robot moving in a vessel that merges with another 
to form a larger vessel will identify the branch just as the vessels merge. 
Quantitatively, the difference path fraction for these two cases shown in 
the figure (about 0.15 for thresholds giving true positives above 80%) cor- 
responds to a difference of about 6 pm for the path lengths used here (see 
Appendix A.1). Thus, the difference in where a branch is first identified 
for splitting or merging vessels is just a few times the robot diameter. 


7.3 Noise 


Sensor measurements are subject to noise, so in practice robots will not have 
exact values for the stress-based quantities used by the classifier. Evaluating 
the effect of noisy measurements on classification accuracy is an important 
performance measure. 

The classifier uses three pieces of information: correlation of two stress 
measurements separated by At, relative position estimated from stress while 
in a straight segment, and principal components from the latest stress used for 
correlation. These quantities involve stress measurements at different times, 
except that one of the stresses used for correlation is the same as used to 
determine principal components. Thus, a reasonable model of the noise is 
independent errors for the three values used as inputs by the classifier. This 
assumes noise at different times, separated by at least a few milliseconds, is 
uncorrelated, for example, as is the case for thermal noise. 

As one example of the effect of independent noise, Fig. 13 shows the 
consequence of relative errors for the area under the trade-off curve for true 
and false positives shown in Fig. 11. For simplicity, the noise used in this 
figure takes each of the three inputs to the classifier to have a noisy value 
given by a random relative error drawn from a normal distribution with zero 
mean and standard deviation equal to the amount of relative noise indicated 
on the horizontal axis of the figure. This shows little change in classifier per- 
formance with up to about 10% noise. More generally, each of the three 
inputs to the classifier could have a different amount of noise, depending 
on how noise from stress measurements propagates to the calculated values 
of correlation, relative position, and principal components. 

If noise is large enough to significantly degrade classifier performance, 
the robot could average the result of several subsequent evaluations. 
For instance, averaging stress measurements over several milliseconds can 
significantly reduce the effect of thermal noise on stress measurements 
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Fig. 13 Area under the trade-off curve as a function of relative noise added to classifier 
inputs. Each value is the average of 100 noisy versions of the measurements along paths 
of all the test samples. The error bars are the standard error of those averages, and are 
only slightly larger than the thickness of the curve connecting the points. 


(Hogg, 2018). This averaging will also improve the stress-based inputs to the 
classifier, provided noise at different times is independent. 

Averaging to reduce the effect of independent noise contrasts with sys- 
tematic errors, which produce noise correlated over time or across different 
sensors. Examples of such systematic errors include a stress sensor giving 
consistently smaller readings than the others due to poor calibration, or if 
sensor responses change as the robot moves through the vessel due to sensors 
becoming covered by material adhering to the robot surface. Another source 
of systematic error is a robot’s clock running at the wrong speed. That could, 
for instance, cause a robot to actually compare stresses separated by At = 
15 ms, while using a classifier trained with correlations with At = 10 ms. 
Such systematic errors are not reduced by averaging so will need to be han- 
dled by designing stable sensors or providing a way to calibrate them while in 
use. Alternatively, if such errors differ among robots, for example, because 
they have somewhat different clock speeds, nearby robots could communi- 
cate the information they use for branch identification. Each robot could 
then average its own measurement with those of other robots to reduce 
the effect of these errors. 





8 Discussion 


This chapter describes how a robot moving with fluid in a small vessel 
can use the changing stress on its surface to identify when it encounters a 
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branch. Repeatedly using this classifier, a robot can identify changes in the 
vessel geometry as it moves. For example, the robot could record the time 
and hence distance, with an estimate of its speed obtained, for example, from 
stress measurements (Hogg, 2018) between its initial approach and final pass- 
ing of a branch. Thus, the robot can determine the size of the branching 
region. Over longer times, the robot could measure distances between suc- 
cessive branches, thereby estimating the larger-scale geometry of successive 
splits and merges of small vessels. 

The classifier in this chapter uses only a few properties of the changing 
stress pattern. These properties are sufficient to identify branches for the sce- 
narios considered here. It remains to be seen how well these properties per- 
form in more complex situations. One such situation is nonplanar branching 
vessels (Sochi, 2015), which require evaluating 3D flows. Another situation 
is the fluid containing a variety of objects in addition to the robot. Such 
objects include cells that deform as they are pushed around curves or into 
branches, requiring more elaborate simulations (Hoskins et al., 2009), espe- 
cially in somewhat larger vessels than considered here (Bagchi, 2007). In 
these or other more complex situations, the properties used in the classifier 
described here may not be sufficient for high accuracy. In such cases, clas- 
sifiers could incorporate additional information available to the robot about 
its local environment. These additions include prior information about ves- 
sel structure and additional measurements. 

For instance, the robot could combine the classifier’s output with prior 
probabilities of branches. This prior could, for instance, consider typical dis- 
tances between successive branches and how often vessels bend without 
branching. Values for the priors could come from studies of microvascula- 
ture in general or in specific organs (Augustin and Koh, 2017) or types of 
tissue (Nagy et al., 2009; Jain et al., 2014). Using priors specific to individual 
organs or tissues would require the robot to determine which organ or type 
of tissue it is in, for example, using chemical signatures or external localizing 
signals (Freitas, 1999). A robot could also adjust its priors based on its recent 
history, for example, using the frequency of verified branches it has encoun- 
tered recently in small vessels. The robot can combine any prior probabilities 
it has with the result Pyyanch from the classifier using Bayes theorem. For 
example, if branches are rare compared to curves, the robot could increase 
the threshold it uses to identify a branch to reduce the number of false pos- 
itives. This would adjust for the use of an equal number of curve and branch 
paths used for the training in this chapter, which corresponds to an equal 
likelihood for the robot to encounter a curve or branch. 
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The robot could use a wider variety of values to aid classification in more 
complex scenarios. For instance, the classifier of this chapter evaluates stress 
changes over a fixed interval of time, namely 10 ms. More generally, robots 
could use stress correlations over multiple time intervals, for example, using 
At values of both 10 and 20 ms. A mix of times could help identify vessel 
structure when flow speed varies over a larger range than considered here, 
for example, due to vessel blockages. 

Another example of additional information the robot could use is a 
broader measure of how stress changes. The correlation measure used here 
measures the change in the shape of the stress pattern on the robot surface. As 
a robot moves, the stress magnitudes change as well. For instance, moving 
into a branch with slower flow typically decreases the stress, whereas moving 
closer to the wall increases it. Thus, another measure of changing stress is 
ratio of current and previous average stress magnitudes over the surface, 
which characterizes the change in the magnitude of stresses. For the cases con- 
sidered here, the change is stress magnitude gives similar information as that 
obtained from the correlation, and does not noticeably improve classifier 
performance. Nevertheless, in other cases, changes in shape and magnitude 
may provide different information, thereby improving performance when 
used together. 

In addition to using the information a robot obtains while passively mov- 
ing with the fluid, robots could actively probe their environments. One such 
approach is making changes to the surface that affect stresses. For instance, a 
robot that can alter its shape (Castano et al., 2000) could measure how its 
shape affects its surface stresses to gain additional information on the nearby 
vessel geometry. Another possibility is for a robot with locomotion capabil- 
ity to alter its distance to the vessel wall before it encounters a branch or 
curve to increase the accuracy of classification or verification after passing 
the change. A robot could move closer to the center of the vessel so its dis- 
tance to the wall will change even more when encountering a branch than a 
curve (see Fig. 9) thereby improving verification. Alternatively, it could 
move closer to the wall so the change in correlation is more distinct between 
branches and curves (see Fig. 6). 

Beyond classifying the type of geometry (e.g., a branch), a robot might use 
stresses to estimate quantitative properties of how the geometry changes. This 
possibility arises from stresses depending on the geometric properties such as 
the branching angle when a vessel splits and the size of the branches, as well as 
the radius of curvature of a curved vessel. Estimating such properties requires 
determining how they influence the stress pattern as the robot moves, and 
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then determining how to extract property values from these influences on 
measured stresses. Such estimates could also benefit from prior information 
on relations between branching angles and diameters (Thompson, 1992). 
Communication among nearby robots could enhance these extensions. In 
particular, when multiple communicating robots pass through a vessel at 
around the same time, they could compare stresses at different positions in 
the vessel. These comparisons could include robots close to the wall or close 
to the middle, and robots approaching, near and past a branch. More broadly, 
robots with a variety of sensors could combine information from stresses with 
other measures, such as changing chemical concentrations or acoustic echoes 
(Freitas, 1999), to evaluate the changing geometry of their environments. 





9 Conclusion 


In summary, a robot can use fluid stresses on its surface to identify 
when it encounters branches in microscopic vessels. The classifier discussed 
here combines three types of information derived from stresses: how stress 
patterns change over a short time, the position of the robot in the vessel 
before it encounters a branch or curve, and the shape of the stress pattern. 
Together, these values accurately distinguish branches from curves for a typ- 
ical range of geometries encountered with microscopic vessels in tissue. 
Moreover, the time over which stresses are compared, for example, 
10 ms, is short enough that the robot moves just a few times its size during 
the evaluation. This allows the classifier to identify branches, while the robot 
is still near the branch. 

Fabrication of microscopic robots with stress sensors and even relatively 
simple computers involve significant technological challenges. Prior to the 
feasibility of robot fabrication, theoretical studies, such as presented in this 
chapter, can quantify likely robot capabilities and their performance in var- 
ious applications. These studies can be useful guides to the kinds of applica- 
tions robots will be able to perform as their capabilities improve. Conversely, 
these studies quantify the performance requirements of the robot sensors and 
computers needed to address these applications. 





Appendix 
A.1 Samples of robot motion in small vessels 


We determine the relationship between surface stresses and vessel geom- 
etry from a set of samples in known geometries. If robots could be 
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fabricated, these samples could be obtained experimentally, for example, 

by measuring forces on microfluidic devices (Wu et al., 2010). Since this 

experimental approach is not yet feasible, we instead create samples from 
numerical solution of the flow with a robot in vessels with various 
geometries. 

We create samples of robot paths for a range of vessel diameters and flow 
speeds corresponding to small blood vessels, with parameters given in 
Table 1. These samples are variations of the situation shown in Fig. 1 with 
parameters chosen uniformly at random according to: 
¢ Maximum inlet fluid speed between 800 and 1000 pm/s. 

* For curved vessels: 

— Vessel diameter between 6 and 13 pm. 

— Bend angle, between direction of inlet and outlet, between 25 and 

75 degrees. 

* Fora vessel splitting into two branches: 

— Diameters of the branches, d; and dz, between 6 and 10 pm. 

— The diameter of the main vessel, d, is determined from d, and db, 
according to Murray’s law (Murray, 1926; Sherman, 1981; Painter 
et al., 2006), that is, d® = d? + d3. 

— The two branch angles chosen uniformly between 25 and 75 degrees 
and —25 and —75 degrees, respectively. 

* Vessel segment length extending 30 tm in each direction from the curve 
or branch. 

* Initial position of robot’s center: eight times the robot radius, that is, 
8r = 8um, from the vessel inlet, and randomly positioned between 
the vessel’s walls with minimum gap 0.2r between the robot surface 
and the wall. 

* Robot orientation between 0 and 360 degrees. 

From the initial robot position, we solve for the robot’s motion through 

the vessel until it comes within 8 pm of an outlet. Boundary conditions on 

the flow are a parabolic velocity profile at the inlet, no-slip along the vessel 

wall and zero pressure at the outlet for a curve, or at both outlets for a 

branch. 

This study used a total of 2000 samples created according to this proce- 
dure, with 1000 for each vessel type, that is, curve or branch. For each of 
these vessel types, 800 samples were used for training the classifier and 
the remaining 200 were used to test the classifier performance. The paths 
in these samples are about 40 fm in length. The fluid typically moves the 
robot along the path in around 100 ms. 


196 Tad Hogg 





B.2 Identifying branches from stress measurements 


This section describes how the vessel branch classifier was trained and the 
parameters of the resulting model. The section also estimates the computa- 
tional requirements for using the trained classifier. 


B.2.1 Regression classifier for branch detection 

This chapter identifies branches with a logistic regression based on three 
characteristics of the robot’s stresses along its path through a vessel. First, 
the correlation between the current stress and that of a short time earlier. 
Second, the robot’s relative position in the vessel evaluated during the 
robot’s most recent passage through a nearly straight section of the vessel. 
The third characteristic is a measure of the shape of the robot’s current 
stresses, specifically the first principal component of the Fourier coefficients 
of the stress pattern (Hogg, 2018). 

The regression model for the probability of a branch, Ppranch, 18 


1 
1+ exp(—b(log(1 —c),rp,p1)) 


where c is the correlation between changing stress patterns, defined in 





Pyranch = (B.1) 


Eq. (2), rp is the relative position, defined in Eq. (3), p; is the first principal 
component of the stress pattern, and 


b(Ic, rp, p1) =P, + Bile + B, rp + By Ic? + By rp + Bs pi 


where the #._ are the parameters, given in Table B.1, determined from the 
training samples. 

Training this regression used stress measurements along the complete 
path of each sample to identify the time with minimum correlation along 
the path. This “off-line” training corresponds to the situation after robots 
complete their paths, so stress measurements all along the paths are available 


Table B.1 Regression parameters for the probability a robot 
encounters a branch, Eq. (B.1) 





Parameter Value Standard error 
Bo — 0.8 0.7 

Bi — 1.7 0.6 

Po 9.0 1.8 

Pia — 0.97 0.11 

Po2 6.8 2.3 


Bs 11.6 0.8 
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for training. Specifically, for each training sample, rp is the relative position 
at the start of the sample path where, by construction, the robot is in a 
straight vessel segment prior to reaching the curve or branch. Moreover, 
cis the minimum correlation along the path, that is, the minimum value 
of c(t, At) along a path, for At = 10 ms. The branch and curve points in 
Fig. 6 are examples of these relative position and correlation values. Finally, 
the value of p; used for training is the principal component of the robot’s 
stress at the time of the minimum correlation. 


B.2.2 Computational requirements 

An important metric for classifiers is the computational cost to train and use 
them. The training considered here is off-line, from stress measurements 
collected along a sample of paths. In this case, training could take place in 
a conventional computer rather than in the robots, and the resulting regres- 
sion parameters stored in the robot’s memory. Thus, training is not signif- 
icantly constrained by the robots’ onboard computational capabilities. 

On the other hand, robots applying the classifier would use their onboard 
computer to repeatedly evaluate the trained classifier from their stress mea- 
surements. Microscopic robots are likely to have limited onboard compu- 
tational capabilities. Thus, it is important to evaluate the computational 
cost for robots using the classifier, and the memory required to store the 
parameters obtained from the training. 

The classifier used in this chapter involves a small set of parameters (see 
Table B.1), and recording several sets of stress measurements (represented by 
their low-frequency Fourier coefficients) to allow evaluating correlations. 
This information amounts to about 100 numbers, which could fit in a kilo- 
byte of memory. The regression parameters are just a few additional num- 
bers, so do not add significantly to the memory requirement. 

The classifier uses simple functions of stress measurements. Specifically, 
Eq. (B.1) involves correlations, estimates of a robot’s relative position, and 
the principal component of Fourier modes of the stresses. All these quantities 
can be computed from a few low-frequency Fourier coefficients of stress 
measurements on the robot’s surface. A computer capable of 10° opera- 
tions/s could evaluate these values every few milliseconds (Hogg, 2018). 

Such computation is well beyond the demonstrated capabilities of cur- 
rent nanoscale computers, for example, DNA or RNA-based logic opera- 
tions (Douglas et al., 2012; Green et al., 2017) or programmable 
microorganisms (Ferber, 2004). However, theoretical analyses indicate 
more elaborate molecular computers could be both small enough to fit 
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within micron-size robots and readily exceed this estimate of the required 
computational performance (Drexler, 1992; Merkle et al., 2018). Although 
such computers cannot yet be manufactured, the same technology required 
to build the micron-scale robots considered in this chapter is also likely to be 
able to fabricate these computers. Thus, whenever these robots can be man- 
ufactured, they likely will have sufficient computing capability to apply the 
stress-based estimates described in this chapter. Nevertheless, early versions 
of such robots may not have sufficient computation to evaluate the classifier, 
but still have enough to encode stress measurements for communication. In 
that case, an alternate method for applying the classifier would be to send 
stress Measurements to an external computer that would evaluate the clas- 
sifier and return the value to the robot. This illustrates how microscopic 
robots could rely on onboard computation or communication, depending 
on which is easier to manufacture. 

The classifier considered here relies on the correlation between stresses 
separated by At = 10 ms. Similar classifiers could be trained with other 
values of At. However, the change in stress and hence the correlation values 
depend on Ar: generally, stresses change more over longer times, leading to 
smaller correlations. Thus, to use a classifier trained with a specific value of 
Atrequires the robot measure correlations over approximately the same time 
interval. For the classifier considered here, this requires the robot have a 
clock with, roughly, millisecond precision over time intervals of tens of mil- 
liseconds. An alternative to onboard clocks is an external timing signal 
(Freitas, 1999). For example, timing signals could use sound waves, which 
travel at about 1500 m/s in water and tissue. Thus, a millisecond-period 
timing signal would travel 1.5 m, thereby providing a common millisecond 
time standard to robots operating within a few centimeters. Such an external 
timing signal would not only provide timing for individual robots, but also a 
global standard for a group of robots, allowing them to synchronize 
measurements. 
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1 Introduction 


Microrobots and miniature robots have been recently designed, stud- 
ied, and employed in different applications, including medical and biological 
operations. Several novel designs have been presented for microrobots; 
however, before introducing them it is needed to know about an untethered 
microagent. The untethered microrobotics is now the superior approach for 
delicate micromanipulations in inaccessible or hardly accessible environ- 
ments with medical purposes. Exemplifications of these environment and 
areas are the circulatory system (Belharet et al., 2011), urinary system and 
prostate (Kristo et al., 2003), central nervous system (Duftfner et al., 2003; 
Zaaroor et al., 2006), eye (Kummer et al., 2010; Yesin et al., 2006), ear 
(Nelson et al., 2010), and fetus (Flake, 2003). Microagents in these environ- 
ments can be utilized for diversity of operations such as the biopsy (De 
Cristofaro et al., 2010), drug delivery (Khalil and Misra, 2017; Nelson 
et al., 2010), marking (Fluckiger and Nelson, 2007), occlusion (Jeong 
et al., 2016), ablation (Kim et al., 2016), and so on (Nelson et al., 2010). 
Accordingly, the key point in designing microrobots is insightful knowledge 
of the operation environment as its target. Most of the proposed microrobots 
have been designed to operate in human body (generically mammals’ bod- 
ies); therefore, it is evident that these microrobots should swim inside body 
fluids in different parts. Relatively intricate and expensive local instruments 
(i.e., microsensors and microactuators) have made researchers prone to 
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benefit from distant sensors, power supply, and actuators in miniature envi- 
ronments. The most promising distant navigation employed for microrobots 
is the magnetic navigation, used in the magnetically driven elastic flagellated 
propulsion (Evans and Lauga, 2010), magnetically driven rigid flagellated 
propulsion (Abbott et al., 2010), and OctoMag system (Kummer et al., 
2010). 

The idea of controlling a microrobot within an intravascular environ- 
ment can be involved with parametric uncertainties and unmodeled dynam- 
ics (Folio and Ferreira, 2017; Arcese et al., 2013; Hund et al., 2017; 
Pourmand et al., 2018), although in a highly viscous environment, using 
a bioinspired flagellated propulsion can accomplish an effective locomotion 
(Evans and Lauga, 2010) that relatively increases the structured and unstruc- 
tured uncertainties (in comparison with other methods). Moreover, pulsatile 
flow causes remarkable disturbances in the system that requires an effective 
robust control strategy. Accordingly, several controllers have been proposed 
for such conditions. For instance, the model predictive (Belharet et al., 
2011), adaptive (Arcese et al., 2013), and H,, (Marino et al., 2014) control 
strategies are presented for microrobots, and they failed to perform an 
effective control in a realistic environment (Folio and Ferreira, 2017). Com- 
paring magnetic resonance propulsion (MRP, particularly executed in the 
magnetic resonance imaging (MRI) device) and magnetically driven 
helical-flagellated propulsion (MHP) results in that MHP produces larger 
propulsive forces; however, it can elevate the uncertainty of the system. 
One of recently introduced methods to deal with the mentioned uncer- 
tainties is considering some of the unstructured uncertainties in the path 
planning of the robot inside endovascular system (Folio and Ferreira, 2017). 

The sliding mode control (SMC) as a robust strategy was employed in 
uncertain nonlinear systems (Slotine and Li, 1991; Sharifi and Moradi, 
2017). The basic issues of this controller are two interconnected phenom- 
enon: the chattering phenomenon and high control effort (Utkin and 
Poznyak, 2013; Aghajanzadeh et al., 2018; Sharifi et al., 2017). The magni- 
tude of a discontinuous SMC input is proportional to the amplitude of 
chattering; therefore, the adaptive siding mode control was introduced to 
reduce the magnitude of SMC gain and the chattering issue (Utkin and 
Poznyak, 2013; Torabi et al., 2017). Moreover, the adaptive sliding mode 
control is one of the best robust strategies for the nonlinear systems that their 
dynamic models cannot be linearly parametrized or the parametrization is 
complicated. 
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Microrobots have some other control issues due to the limitation of 
applicable equipment such as the precision of sensory data and the under- 
actuation characteristic. Furthermore, microrobots in the fields of bio- 
robotics (Nelson et al., 2010; Abbott et al., 2010) have currently 
encountered some considerations such as biocompatibility and a large num- 
ber of uncertainties due to the interaction with biosystems. As a result, 
developed control models for varieties of these microrobots (Arcese et al., 
2012) have been operated in the circulatory system involved with 
unmodeled dynamics (Belharet et al., 2011) and structured uncertainties 
(Arcese et al., 2012; Hund et al., 2017; Kenner, 1989). 

With respect to these issues, the sliding mode control (SMC) method 
with robustness property against structured and unstructured uncertainties 
seems to be an effective strategy for the control of endovascular microrobots. 
Accordingly, a nonlinear adaptive sliding mode controller is designed for the 
first tume in this work for a magnetically driven monohelical flagellated 
microrobot. To resolve the chattering issue and autonomously overcome 
uncertainties, an adaptation law is presented for online adjustment of the 
controller gain. The global stability and tracking convergence of the pro- 
posed control method is proven via the Lyapunov theorem. In addition, 
a three-dimensional (3D) optimal path planning is employed based on the 
dynamic programming (DP) for generating the desired trajectory of the 
microrobot. Some simulations are executed to evaluate the objective 
achievement and the controller performance. 





2 3D optimal path planning 


Path planning in 2D environment has been widely used and discussed 
for microrobots; however, a 3D path planning is necessary for the endo- 
vascular environment. Due to the lack of direct measurement of the micro- 
agent velocity using currently available imaging devices, an appropriate 
feedback controller has to be devised instead of previous approaches needed 
the velocity signal. Firstly, it is considered that we have a 3D image of the 
vascular system obtained from MRI, computed tomography (CT), or any 
other imaging devices. In the domain Cp CR? that is in the permissible 
space of the microrobot operation, any path starts from p(0) € Cp and ends 
at p(1) € Cp can be expressed by 


p:1€ [0,1] + pl!) € Cp (1) 
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Now, the control effort is defined as 


w(°(P)) me) = arg max (fn(p(!)) - o(p(/))), (2) 


where fin and v are the control force and micororbot velocity, respectively, at 
each location p(/) of the path (Folio and Ferreira, 2017). 

Assumption. The induced magnetic force is controllable in any direction 
and the flow velocity is not directly measurable since conventional imaging 
devices cannot provide such data. Thus, the control effort metric is deter- 
mined based on the velocity distribution obtained from the steady-state 
solution of Navier-Stokes equations for an uniform flow in the walled space 
(Munson et al., 2014). Fig. 1 shows an illustration of the scaled control effort 
metric in a 2D space (the result is comparable with the one in Folio and 
Ferreira, 2017). 

Then, a performance measure based on the control effort metric can be 
developed as 


1 
je) = [ w(o(0)- [loll 8) 
0 
Therefore, the optimum path with minimum effort can be found from 


p* = arg min J(p). (4) 


Considering the image as a discrete domain, the first step for finding the 
solution of Eq. (4) by the dynamic programming (DP) approach (Kirk, 
2012) is meshing this domain. After generating an adequately small mesh, 
each node has directly reachable neighbors. Thus, according to the 


Low High 





Fig. 1 An illustration for the magnitude of weighted objective function based on min- 
imum effort, defined in Eq. (2), for a 2D image: The color bar demonstrates how this 
magnitude would be high or low. Note that the magnitude of this function is higher 
wherever the pressure is lower. 
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optimality principle (Kirk, 2012), for a path that contains the nodes G, H, 
and J, there is a total optimum path as J* Gy =J* oy + J* yy. For this purpose: 
(1) either destination or start point is considered as the initial point of DP (as 
the solution is reversible), (2) the minimum cost of a path from each node to 
its neighborhood nodes is calculated, and (3) different paths between start 
and destination points in the domain are analyzed and the optimum total 
path with the minimum total cost is obtained. In the perspective of time 
complexity, it is noteworthy that gradient-based methods are superior to 
the proposed method if the search space of problem (4) is smooth 
(Pourmand et al., 2019). 





3 Dynamic modeling 


The dynamic model of the monohelical swimming microrobot 
(shown in Fig. 2) is presented in this section. Study of the monohelical 
swimming microrobot is beneficial for generic acquaintance to microrobots 
dynamics, since large number of microrobots designed to have a bead 
(Belharet et al., 2011) and single (Dreyfus et al., 2005) or multiple flagella 
(Pourmand et al., 2018). The viscous force applied on each element of 


the helix (ds,) has normal and tangential components obtained as 
dF, = —C, V ds), 
(5) 
dP) =—Cy Vi dsp, 


where from the geometry of the helix, normal and tangential velocities are 
formulated as 


Vi =—V, sinf, + RQ cosf, 


: 6 
VY = V, cos, + RQsinf, ) 





(A) (B) t 


Fig. 2 (A) Schematic picture of the proposed magnetically driven helical swimming 
microrobot: the spherical head can contain the operation essentials and the tail is just 
for exerting the propulsion, and (B) demonstration of the parameters and the tangential 
and normal forces on the helix. 
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and the normal and tangential viscous drag coefficients are given in Abbott 
et al. (2010) as 











C ath a 6: i (7) 
= 0.722R l py eR 
n 
dsinf, dsinf, 


In Eqs. (6) and (7), V, is magnitude of the robot velocity along its approach 
vector, Q is magnitude of the robot angular velocity around its approach vec- 
tor, R is the helix radius, f, is the helix pitch angle. 7 and d are also the fluid 
viscosity and the microrobot filament diameter, respectively. Therefore, the 


propulsive force along the approach vector for each element along the helixis: 
dF = dP cosf, —dF sin, (8) 


Substituting Eq. (6) in Eq. (5) leads to 


dF, = je. V, sinp, — C, RQ cosf, dsp, 


ce (9) 
dP = |-< V, cosf,, = Cj RQ sin, ds), 
, and substituting these equations in Eq. (8) leads to 
dF= { |-< V, cosp,, — Cy) RQ sin, cosf, 

+ |C, RQcosp, — C. V, sin, sing, ds (10) 

By integrating the resultant equation along the helix, we have: 

F=22RN (R(CL — Cj) Q cos, = (c. sinf, + C| cos*B, csc) V.), 

(11) 


where N denotes the number of helix turns. 
The hydrodynamic drag force of the microrobot head is obtained using 
the drag coefficient of spherical beads as 


Ls has = 
Fg =5PAv oo Civ (12) 


in which p, A, Cy, Vo, and Vy denote the fluid density, the reference area, 
the superficial velocity in an infinitely uniform flow, and the unit vector of 
the superficial velocity. Since the proposed microrobot operates inside the 
circulatory system, it is essential to consider the wall effect (Kehlenbeck and 
Felice, 1999) of the vessels as 
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[Fl] 1-4,” 
= 7a (13) 
||| (2) : 
ji 
Xo 
where ||-|| is Euclidean norm, and 4, and 4, are dimensionless parameters 
defined as 
0.27 + 0.06Re”-? 
do = 1+0.05Re°- ” Ay = D/2r (14) 


in which D, r, and Re are the robot spherical head diameter, the vessel radius, 
and the Reynolds number, respectively. One of the most accurate hydrody- 
namic drag coefficients of spherical beads in laminar flow was proposed 
recently in Barati et al. (2014) as 


6C 
oe citanh (Te i)" corant (Tr 7) t count (F8 ") 


CyC 
+ C7 tanh + Co tanh eae ase + Ci 
Ta 7 [|x|] + Cue 





(15) 


with the following coefficient values: 


[C, Cy C3 Cy Cy Co Cy Cg Cy Cro Cun Cie] 
= [5.4856 4.3774 0.0709 700.6574 0.3894 74.1539 
—0.1198 7429.0843 1.7174 9.9851 2.3384 0.4744] (16) 


and 


nl 
Dp 
Using Eqs. (11)-(16), Eq. (12) can be rewritten as 


{lel} | 0.65 
(1 +00 
m C 
8 sll 
oo . 
C4 6C 
(a 7) t coenh (Ti Tt Coton (Sr i) 


Cg CioC 
—s 2 + Gytanh (ee = —] + Cr) ls 
(17) 








(c 1 tanh ( 
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where x is the robot position. A spherical magnetic bead attached to the heli- 
cal tail produces a magnetic torque generating the corkscrew effect (Chwang 


and Wu, 1971) determined as Irs = /V,, Mx B, where /,, is the volume of 


= => 
magnetic material in the bead, and M and B are the bead magnetization vec- 
tor and the oscillating magnetic field with the frequency of @, respectively. 
Then, a feasible control input is defined as 





(18) 


Considering apparent weight as W, = V;(p, —p) g with V,, py, and g as the 
bead volume, the bead density, and gravitational acceleration, respectively, 
knowing F and F, from Eq. (11) and Eq. (17), and using Eq. (18), the 
dynamics (equation of motion, i.e., mx =F —Fg+ W,) of the microrobot 
is formulated as 


2nR?N(C, — C)) cosB,, 
u 


m 


x= 





2 


22RN 


m 


mp D 








(c. sinB, + C| cos*B, csc) 


8m (2) 
po) = 
2r 
l|2-I| 0.65 2 2 
_ Ia) 
OC 
e||\O% (<i (Er a 
0.27 +0. 06( em 
ott 7) * stab (Fr 7) * Granb (Fr 1) 


CyyC 
=f Cy tanh Gata) Al Ci2 \|>|| xt W, (19) 
[<I] + Cue 


Based on Eq. (19), it can be written that 


x= But f(x), (20) 


Le 
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where f and f(x) can be obtained by comparing Eqs. (19), (20). 

Other forces (e.g., van der Waals interaction) are not considered in this 
dynamic model (19) for the proposed microrobot because these forces are 
significantly smaller with lower order of magnitude compared to the hydro- 
dynamic drag force. 





4 Adaptive sliding mode control 


The presence of structured uncertainties (such as inaccuracy of viscos- 
ity and density parameters) is possible in the modeled dynamics. Moreover, 
unstructured uncertainties due to existence of the pulsatile flow and negli- 
gence of the low-order forces will affect the system performance. Therefore, 
the application of robust controllers seems to be inevitable for these micro- 
robotic systems. Although the sliding mode control scheme has been rec- 
ommended as an appropriate robust controller (Slotine and Li, 1991) for 
uncertain dynamical systems, to exert this control method it is necessary 
to cope with two interconnected issues: the chattering phenomenon and 
the high magnitude of control action (Utkin and Poznyak, 2013). Accord- 
ingly, an adaptive version of the sliding mode strategy is employed in this 
work to control the microrobot inside the circulatory system, handle the 
chattering properly, and reduce the high activity of control action. Based 
on boundedness of fand # in Eq. (20), one can write: 


lf —f] < Se; if <Bp, (21) 








where B and ip are the estimated values of # and fin Eq. (20), respectively. The 
desired state (trajectory) of the microrobot is considered as 
[ Cee an gg | , where nis the order of system dynamics, and the posi- 
tion tracking error is defined as xX=x—xq. Since the microrobot has a 
second-order dynamics (19), i.e., n=2, the sliding surface is defined as 
n-1 . 

= (5 + i) x= x+Ax, where / is a positive constant. Differentiating 
this surface and using the system dynamics (20), it can be expressed that 


§= Put f(x) — 149% (22) 
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To make s=0, the best approximation for the control law is 
i= 3( —f(%)+X4 — 4). Now, by adding the robust term ksgn(s) to the 
control input for converging to the sliding surface s=0 in the presence of 
modeling uncertainties, we have: 





us f+xy Ax ksgn(s)), (23) 


where k is a positive time-varying robust gain updating by the following 
adaptation law: 


k=als (24) 


in which @ is a positive constant. 
The closed-loop dynamics of the microrobot is obtained by substituting the 
control law (23) into Eq. (22) and doing some mathematical operations as 


i= Glee ) + (5-1)s +(1-§) Ne 25 
ce ft 3 (25) 


To prove the oe and tracking convergence of the controlled micro- 


follows: 


robot, the following Lyapunov function is considered: 


v=3(?+ a 1°) 20, (26) 
Pp 


where 7 is a positive value that will be discussed later. The time derivative of 





the Lyapunov function is obtained: 


B x yo 
x k—-y). 27 
bat Y) (27) 


v= 





Substituting the closed-loop dynamics (25) into Eq. (27), yields 


= “3 B (5- )s +( 5) s+ io! = 

=s ~k sen(s 1 1 Ax k(k 

( g (s) f fa ( Y) 
(28) 


Using the adaptation law (24), the time derivative of the Lyapunov control 
function is obtained as 


aa Fives) aap (5-1) +(1-§) ns) + 5ul(e-7) 


(29) 
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After a few simplifications, Eq. (29) can be rewritten as 


PUG (seta (Sr f+(1 Na+(é 1) a) + (@-R(sen(9)*) -7) 


(30) 





The term (k —k (sgn(s))”) is always zero unless s=0, in which case k = 0 
based on the update rule (24), ie., k remains finite. Therefore, if s=0 
(the microrobot trajectory converged to the sliding surface), y is considered 
such large in the Lyapunov function (26) that 


k<y (31) 


Thus, it is guaranteed that ve 0. On the other hand, ifs 40, y is considered 
such large that 


bri (1-8) (F-1) nx 


Accordingly, V <0 in this case. Regarding the time derivatives of x that are 
assumed to be bounded, there exists a bounded (positive) value for y, which 
is large enough to satisfy both inequalities (31) and (32). Therefore, by 
choosing a proper value for y, the time derivative of the Lyapunov function 


+|s|<y (32) 





is negative semidefinite. Consequently, Eqs. (30)—(32) result in 
_ Po 
V< —wp,(t) = ee <0 (33) 


Since wp(t) = (6/2) s’ is a uniformly continuous function, integrating 
Eq. (33) from zero to t— oo gives 


to 


tim [ we(e)de< V(0) — V(co) (34) 
0 


Based on the negative semidefiniteness of V<0, V(0) — V(ce) is positive and 
finite in Eq. (34). Therefore, according to Eqs. (33), (34), limj—o fi wp(t)dt 
exists and it is positive and finite. As a result, based on Barbalat’s lemma, it is 
obtained that 


lim w(t) = mee =, (35) 
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Thus, as (B/B) is nonzero and positive, Eq. (35) implies that lim)_,..s=0. 


Regarding the definition of s=x+Ax, the convergence to desired trajec- 
tory x= (x—x,4) 0 is concluded. Due to the positive definiteness of the 
Lyapunov function and the negative semidefiniteness of its time derivative, 
the proposed adaptive sliding mode control method guarantees the global 
stability, robustness against the bounded modeling uncertainties, and the 
racking convergence of the microrobot to the desired trajectory xy. 





5 Simulation results 


The proposed control strategy for the endovascular swimming micro- 
robot is evaluated via some simulations in this section. The human body cir- 
culatory system in arterioles with three different disturbances is included in 
these simulations. Parameters of the helix tail and head of microrobot are 
presented in Table 1, which are compatible with the data presented in 
Nourmohammadi et al. (2016) and Folio and Ferreira (2017). 

One of the most challenging disturbances in arterioles is the pulsatile flow 
that is considered as (Munson et al., 2014; Belharet et al., 2011) 


ae 102\ \ 
o(t) =0.001 (.- (x) (1+1.15c0 (2m+ =) ) - (36) 
R, 16 


where ¢ is the unit vector along the vessel centerline. To more evaluate the 
robustness of the proposed control method, sinusoidal disturbances are con- 
sidered in the fluid density and viscosity and applied in the simulations as 


n)=17.5 +3sin (=) (37) 


2nt 
p(t) =1057 + 12sin (=) (38) 


Table 1 Parameters of the helix tail and head of the 





microrobot. 

Parameters Dimensions and values 
B,, helix angle 75 degrees 

N, helix revolutions 5 

d, filament diameter 20 (um) 

D, spherical head diameter 700 (um) 


R, helix amplitude 250 ([um) 
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The constants of the blood viscosity and density magnitude are extracted from 
Nelson et al. (2010). After finding the optimal path, corresponding to the min- 
imum effort, inside a 3D complex phantom of endovascular system (shown in 
Fig. 3), the trajectory tracking is achieved in the presence of artificial pulsatile 
flow, density, and viscosity variation as illustrated in Figs. 3-5. 

Fig. 4A demonstrates that the position error of the microrobot with 
respect to its desired trajectory that is controlled and converged to zero in 
the endovascular phantom with the mean diameter of 3mm (Dong and 
Nelson, 2007; Nelson et al., 2010). In addition, Fig. 5A shows that after pass- 
ing a bounded time, adaptive gains of the robust controller grow enough to 
overcome modeling uncertainties and disturbances and to control the robot 
position close to its desired trajectory (Fig. 3). Note that without any distur- 
bance in the system, the robust gains are relatively small and autonomously 
reach small saturation levels as shown in Fig. 5B. The deviation of the micro- 
robot velocity from the desired velocity in Fig. 4B remains small even in the 
frequency of artificial pulsatile flow and viscosity disturbance. The control 
inputs in 3 directions are also demonstrated in Fig. 4C. The magnitude of 
these control components is saturated to be <3 rad/s. 

For the sake of comparison and demonstration of the proposed adaptive 
sliding mode control method’s efficiency, the sliding mode gains (elements 
of k) fixated on the constant values of 1 and 3 without employing the update 
rule (24). In these conditions, the control input, and trajectory tracking of 
the velocity and position in the presence of disturbances are illustrated in 
Fig. 6. Comparing Fig. 6A and 6D implies that the control effort is a little 
higher at intervals when the robust gains are 3 in comparison with the case 
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Fig. 3 Trajectory tracking of an optimal minimum-effort path in the presence of 
disturbances. 
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Fig. 4 (A) Convergence of the position error, (B) tracking of the desired velocity, and 
(C) control input of the swimming microrobot in the presence of artificial pulsatile flow, 
blood density, and viscosity disturbances. 
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Fig. 5 Adaptation of robust gains during the microrobot motion (A) in the presence of 
disturbances and (B) without any disturbance. 
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Fig. 6 (A) The control input, (B) the velocity tracking, and (C) the position error for the 
steady sliding mode gains with the value of 1 and (D) the control input, (E) the velocity 
tracking, and (F) the position error for the steady sliding mode gains with the value of 3. 


having the value of 1 for these gains. However, it could be mentioned that 
when the robust gains of the controller are larger, the position and velocity 
errors become smaller. The analogy of Figs. 4 and 6 clarifies how the online 
adjustment of the adaptive sliding mode gain k (Fig. 5) in the proposed con- 
trol strategy is effective in decreasing the trajectory tracking errors by 
suggesting an efficient control effort. 

Assuming the initial value of the gains is equal to 1 in the adaptive control 
scheme, the obtained results of the closed-loop system are demonstrated in 
Fig. 7. Note that the initial value of the robust gains was zero in Figs. 4 and 5. 
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Fig. 7 The simulation results when the initial values of the robust controller gains is con- 
sidered 1: (A) the gains adaptation, (B) the position error, (C) the velocity tracking, and 
(D) the control inputs. 


Based on Figs. 5A and 7A, it can be concluded that the adaptive performance 
of the controller in the presence of various uncertainties is achieved success- 
fully that is in accordance with the control objectives and the Lyapunov sta- 
bility analysis. Comparison of Fig. 4A with Fig. 7B and Fig. 4B with Fig. 7C 
intimates that the convergence of position and velocity trajectories 1s pro- 
vided more appropriately when a larger initial value is assumed for the con- 
troller’s time-varying robust gains. Specifically, a faster convergence rate of 
the transient response is seen in the initial part of the microrobot’s motion. 
However, with reference to Figs. 4C and 7D, the control effort is lower in 
the case when the initial value of the robust gains is zero. From the control 
inputs of all four simulation studies presented in the presence of disturbances 
shown in Figs. 5—7, it is concluded that not only the control effort increases 
due to the rise of robust gains, but also the system chattering around the slid- 
ing surface occurs more often (the frequency and amplitude of this phenom- 
enon are elevated). Therefore, it is recommended that the initial values of 
the controller’s robust gains are considered small when the appropriate 
steady-state levels of these gains are unknown. 


Navigation and control of endovascular helical swimming microrobot 217 








6 Conclusion 


The main goals of the present chapter were (1) introducing an accurate 
and well-clarified dynamic model of the microrobot, (2) deployment of an 
optimal 3D path planning, and (3) mathematical formulation and designing a 
proper robust controller with adaptive gains. In this work, an adaptive slid- 
ing mode control method was presented for a monohelical-flagellated end- 
ovascular microrobot, for the first time. Since this type of microrobots deals 
with more challenging uncertainties in comparison with the magnetic res- 
onance propulsion (MRP) systems due to the disturbances and inaccuracy of 
dynamic parameters, a robust adaptive control strategy was designed and 
adopted in this study. An optimality principle was employed for the path 
planning of the microrobot with a minimum effort criterion using dynamic 
programming (DP) in three dimensions to obtain the desired robot trajec- 
tory for the controller. The dynamic model of the microrobot was devel- 
oped and its physical interaction inside the circulatory vascular system as 
the most dominant force (1.e., the hydrodynamic drag) was thoroughly taken 
into account. It was proven using the Lyapunov theorem that the controller 
guarantees the stability and tracking convergence in the presence of distur- 
bances. Robustness and performance of the proposed control method is 
evaluated by some simulations considering the most important uncertainties 
in vascular system (the pulsatile flow, blood density, and viscosity fluctua- 
tions and inaccuracies). 
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1 Introduction 


Before 1970, open surgery was the most frequently used access for 
inflammatory diseases involving the frontal and maxillary sinus (Trevillot 
et al., 2013b). The Austrian surgeons Messerklinger and Stammberger 
pioneered a new, revolutionary procedure. They promoted a paradigm shift 
in the treatment of sinonasal inflammatory disease and developed the con- 
cept of functional endoscopic sinus surgery, taking profit of the magnifica- 
tion of anatomical structures provided by the endoscope (Trevillot et al., 
2013a). This concept further evolved in endoscopic transsphenoidal surgery 
for the treatment of sellar tumors and, more recently, in Endoscopic tran- 
snasal Skull Base Surgery (ESBS) (Doglietto et al., 2005). The main advan- 
tage of transnasal endoscopic skull base approaches is providing a more direct 
and less invasive access to the skull base, avoiding craniofacial incisions and 
extensive bone removal, typical of open surgical approaches (Kupferman 
and Hanna, 2014; Doglietto et al., 2018). 

With the increasing complexity of transnasal endoscopic surgery, the 
need for a bimanual dissection became evident (Cabuk et al., 2015) and 
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the so-called four hands technique has been developed (Castelnuovo et al., 
2006). The technique entails a combined work by at least two surgeons, of 
whom one holds the endoscope and the other is responsible for surgical dis- 
section; the technique therefore requires a close collaboration between the 
two surgeons. Nonetheless, even among closely collaborating teams various 
issues can become evident, especially in long and complex operations 
(Trevillot et al., 2013a): the surgeon holding the endoscope has to coordi- 
nate with the other as to optimize visualization and surgical maneuverability 
of up to three instruments that might have to be introduced in a typically 
narrow and long surgical corridor; the need for a close-up but fixed image 
might be challenging in case of long procedures because of physiological 
tremor (Bolzoni Villaret et al., 2017). 

The increasing complexity of transnasal endoscopic skull base surgery has 
therefore led to the demand for an endoscope holder (Chan et al., 2016). 
Until recently, though, only a few centers have used endoscope holders sys- 
tematically (Paraskevopoulos et al., 2016, 2018), mainly because a change of 
view usually requires the use of one hand by the surgeon and the maneu- 
verability of the endoscope is suboptimal. A robotic endoscope holder 
would theoretically have the same advantages of nonrobotic holders, includ- 
ing tremor filtration (Blanco and Boahene, 2013), but also a higher accuracy 
in endoscope movements, which might be performed without the need ofa 
surgeon’s hand (Bolzoni Villaret et al., 2017). 

Robotics, in the last two decades, has been applied to multiple surgical 
specialties, including cardiac surgery, urology, gynecology, and, most 
recently, minimally invasive head and neck surgery (O’malley and 
Weinstein, 2007). Da Vinci® Robotic System (Intuitive Surgical, Sunny- 
vale, CA, USA) and Flex” Robotic System (Medrobotics, Raynham, 
MA, USA) are commercially available robots approved for head and neck 
surgery, though mainly limited to thyroid or transoral surgery. These sys- 
tems have not been designed for ESBS and consequently they show several 
limitations when applied to it. These limitations include poor ergonomics 
and large dimensions, which require a working space that is typically not 
available in ESBS (Bolzoni Villaret et al., 2017). 

Significant advances in surgical robotics have been made, but a central 
role for robot-based applications in transnasal skull base surgery has not been 
defined (Blanco and Boahene, 2013). Recently, several prototypes for endo- 
scopic transnasal skull base surgery have been developed, but with some dis- 
advantages, including ergonomics and prolonged set-up time (Bolzoni 
Villaret et al., 2017). 
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To overcome the limits of previous robotic prototypes, novel hybrid 
solutions, conceptually dissimilar from a purely robotic surgery, have been 
also developed: the robotic system has the task of holding the endoscope, 
remaining entirely dependent on the surgeon (Bolzoni Villaret et al., 
2017). This solution is defined hybrid as the robotic system is not “pure,” 
but the robotic holder works with the surgeon at the patient’s side; for this 
reason, it is also defined “collaborative.” 

Recently, a hybrid robotic solution for ESBS has become available 
(EndoscopeRobot™, Medineering, Munich, Germany): it is made of a 
robotic arm together with a smaller robot that acts as an endoscope holder 
that can be controlled with a foot pedal. As the system has been introduced 
only recently, there are no preclinical or clinical reports on it. 

The aim of this chapter is to provide a comprehensive critical overview 
of nonrobotic endoscope holders and of the different robotic prototypes that 
have been developed for ESBS, together with a brief presentation of preclin- 
ical and clinical data on the use, at the University of Brescia—Italy, of this 
commercially available hybrid solution for ESBS. 





2 Nonrobotic endoscope holders 


The increasing complexity of transnasal endoscopic skull base surgery 
has led to the augmentation of the time dedicated to tumor removal, leading 
to an increasing demand for an endoscope holder (Chan et al., 2016), as it 
can provide a steady vision, eliminating the human physiological tremor, 
which increases with fatigue. Until recently, though, only few centers have 
used endoscope holders systematically (Paraskevopoulos et al., 2016, 2018), 
mainly because a change of view usually requires the use of one hand by the 
surgeon and the maneuverability of the endoscope is suboptimal. 

Over the years, several solutions have been reported. To understand the 
evolution of endoscope holders (EH), Paraskevopoulos et al. (2016, 2018) 
conducted an overview of available devices, identifying their main features, 
advantages, and limitations. 

Endoscope holders can be divided into mechanical and pneumatic-based 
systems (Table 1). 


2.1 Mechanical fixation type 

Leyla arm is the cheapest holding device and two microsurgical arms 
attached to a plate that holds the endoscope comprise it (Jimenez, 2019). 
The position of the flexible holding arm and the Leyla retractor can be 


Table 1 Summary of the analyzed features for each endoscope holder. 





Endoscope holder Fixation type Advantages Limitations 
Point Setter” Pneumatic Nitrogen-powered endoscope stabilizer Bulky 
(Mitaka Kohki, Co., Quick release mechanism It requires a gas supply (N2 or 
Ltd., Tokyo) Single-hand control compressed air) 
6 Joints (including one manual joint) Quite expensive 
Unitrac” Pneumatic Pneumatically powered retraction and scope holding system It requires compressed air 
(Aesculap AG, Connect with NeuroPilot for fine adjustment source (or CO, cartridge) 
Tuttlingen, 
Germany) 
Leyla arm Mechanical Wide availability Cumbersome 
Inexpensiveness It requires of 2 arms for safe 
Familiarity endoscope fixation 
*““Snake”-type of Mechanical Similar to Leyla arm Bulky, crude, and outdated 
friction holder Some occasional downward 
(Aesculap AG, drift 
Tuttlingen, 
Germany) 
Neuroarm™ Mechanical It holds different tools Cumbersome 
(Adeor Medical AG, Simple It requires of 2 arms for safe 
Pullach, Germany) endoscope fixation 
M-TRAC® Mechanical Flexible holding device Minimal downward drift 
(Aesculap AG, Small, supple joints for fine positioning 
Tuttlingen, Autoclavable 
Germany) 


Endoarm”® (Eskandari 
et al., 2008) 
(Olympus Co., 
Tokyo, Japan) 


Endocrane” 
(Karl Storz GmbH & 
Co. KG, Tuttlingen, 
Germany) 


Hybrid endoscope-holder 


system 


Piezoelectric locking 
mechanism 


Solid fixation and smooth relaxation. 


Easily maneuverable 
Bayonet-shaped endoscope 


Integrated with a video system to facilitate endoscopic 


microneurosu rger 


Bulky 


Faster positioning compared to manual positioning systems NA 


Rapid locking 
Single-hand use 
Fail-safe function 
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adjusted in three dimensions. The major advantages of the system are its 
availability, cost, and the familiarity with its use by most neurosurgeons. 
As for every mechanical holder, its main limit is the requirement of two arms 
for safe endoscope fixation. 

Another similar mechanical device is the “‘snake’’-type friction holder, 
available by Aesculap AG (Tuttlingen, Germany). It includes several endo- 
scope adapter inserts and a tip for fine adjustments. As for other systems, it has 
some occasional downward drift upon fixation. 

Fine corrections or adjustments are necessary after positioning the neu- 
roendoscope to receive the optimal endoscopic image. With traditional 
holding devices only a rough positioning is possible; the NeuroPilot Micro 
Steering System is a mechanical system that provides a precise and fine 
steering of the neuroendoscope to achieve clearer visualization. 

Neuroarm® (Neuroarm, 2019) (Adeor™ Medical AG, Pullach, Germany) 
has been created in order to hold different tools, such as retractor blades, 
endoscopes, or other instrument in a fixed position. It is a simple system, 
similar to Leyla arms, and with the same limitations. 

M-TRAC® (M-TRAC®, 2019) is another mechanical holding arm by 
Aesculap (Aesculap AG, Tuttlingen, Germany). It is a flexible holding 
device with mechanical fixation by clamping handle. The device has small, 
supple joints for fine positioning and it is autoclavable. A minimal downward 
drift can be compensated by Neuropilot micromanipulator. 


2.2 Pneumatic fixation holders 


The minimal downward shift that characterizes mechanical systems is usually 
not present in pneumatic-based endoscope holders. 

One of the most useful holders is probably the Point Setter (Point 
Setter, 2015), developed originally by Mitaka (Mitaka Kohki, Co., Ltd., 
Tokyo, Japan) and distributed outside Japan by Karl Storz (Karl Storz GmbH 
& Co. KG, Tuttlingen, Germany and KSEA, CA, USA). The Point Setter 
works as a third arm that can hold various endoscopes of many manufac- 
turers and it can be attached on either rail of the operating table through 
an adapter. This endoscope holder is a nitrogen-powered endoscope stabi- 
lizer and it provides precise positioning (Arnholt and Mair, 2002). The 
holder arm has a total of six joints, including one manual joint and three ball 
joints. For optimal positioning, the surgeon can adjust the angle with the 
manual ball joint adjust knob. The Point Setter has a reliable safety mech- 
anism, which causes the arm to be locked when the power or nitrogen gas 
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pressure is down. The system offers comfortable use, low friction, good bal- 
ance and a rigid, safe design. The quick release mechanism is quite useful and 
single-hand control is possible. 

The Unitrac® (Unitrac™, 2019) holding arm from Aesculap (Aesculap 
AG, Tuttlingen, Germany) is used in procedures that require limited endo- 
scope movements. It is a pneumatically powered retraction and scope- 
holding system that allows the surgeon to perform a more efficient 
procedure. 

EndoArm (Olympus Co., Tokyo, Japan) was developed by the collab- 
oration of neurosurgeons from three institutions (University of Tokyo, 
Tokyo Women’s Medical University, Kinki University) with a commercial 
manufacturer (Olympus Co., Tokyo, Japan). A pneumatic arm with several 
ball-and-socket style joints allows for movement of the endoscope. A single 
button locks and releases the pneumatic clutch device and allows for move- 
ment in all planes with one hand. For a solid fixation and smooth relaxation 
mechanism, a negatively actuated air-locking system was developed, which 
locks the scope automatically and releases it by activating the air pressure 
(Eskandari et al., 2008). 

In daily surgical practice, most teams do not routinely use pneumatic 
arms to secure the endoscope (they require compressed air and are quite 
expensive), but have found them useful in selected lengthy cases 
(Chowdhry and Cohen, 2013). 


2.3 Piezoelectric fixation holders 


A recent technological alternative is represented by Endocrane from Karl 
Storz that features a special piezoelectric locking joint mechanism. It can 
achieve positioning without misalignment thanks to a rapid locking mech- 
anism. The compact holding arm features a fail-safe function, which pre- 
vents a loss of retention force in the case of malfunction, i.e., power failure. 


2.4 Survey on endoscope holders 


Paraskevopoulos et al. (2016, 2018) recently performed a survey among 
neurosurgeons regarding the use of endoscopic holders. 

The results of the survey underlined that most neurosurgeons prefer not 
to use an endoscope holder and those who responded that they use an EH, 
mainly use a holder for ventricular rather than skull base procedures. Fur- 
thermore, most surgeons regularly work with a cosurgeon. 
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The responders stressed the positive and negative features of endoscope 
holders: 

— Positive features: stability, number of joints, maneuverability, safety; 

— Negative features: raw movements, limited degrees of freedom as com- 
pared to free hand, downward drift, lack of flexibility, iatrogenic injury, 
expensive, too bulky. 

The same group conducted a second, wider, and more specific survey 

(Paraskevopoulos et al., 2018) after the pilot one; in particular, they tried 

to differentiate between different uses of EHs, such as intraventricular versus 

skull base, specific procedures, and pitfalls. In this second study, the authors 
reported pitfalls of endoscope holders in different applications. 

Pitfalls that were reported and were specific to skull base surgery 
included: 

— Cleaning difficulties: maintaining a clear vision is of paramount impor- 
tance in surgery; when the endoscope is introduced in the nose, even 
minor bleeding might impair visualization and lead to the need of lens 
cleaning. This is usually achieved with commercially available cleaning 
systems that flush saline solution on the lens; when this is not enough, 
the endoscope might have to be removed from the nose to be cleaned; 

— Need to incorporate the limitations of the holder into the operative 
planning. 

Regarding pitfalls in both intraventricular and skull base surgery: 

— Not dynamic with limited maneuverability: limited degrees of freedom as 
compared to free hand; 

— Time consuming and cumbersome: the main issue is usually related to the 
space that is required by the holder, as this might occupy significant space, 
usually used by the assistant surgeon; set-up time might be time 
consuming; 

— Difficult to get in the appropriate position: with some systems positioning 
is not optimal due to the delay in the locking system or due to the absence 
of minor movements that are needed to obtain an optimal position in con- 
fined, small areas; 

— Restricted range of motion because of geometry of the holder; 

— Shifting of holder or accidental loosening (esp. mechanical arm): scope 
may slip and may be inadvertently displaced by assistant or surgeon, so 
scope holder is one more tool to pay attention to during surgery; 

— Failure to hold the scope; 

— Downward drift: articulated arms can help to prevent fatigue in lengthy 
cases, but are often prone to drifting downwards during initial positioning, 
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thus making minor adjustments necessary, either in anticipation of this 
downward drift or after initial positioning. 
Although endoscopic holders have a role in cranial neuroendoscopy, their 
use seems limited and their features are regarded as suboptimal by most neu- 
rosurgeons. To overcome the limitations of nonrobotic holders, in the last 
two decades, modern technology allowed robotic applications to be consid- 
ered (Paraskevopoulos et al., 2018). 





3 Prototypes for endoscopic transnasal skull base 
surgery: Literature review and personal experience 


A recent systematic literature review on the current status of robotics 
for endoscopic transnasal skull base surgery (ESBS) (Bolzoni Villaret et al., 
2017) was updated, searching Pubmed and Google Scholar with the follow- 
ing key words: “Robotic skull base surgery” and “Robotic transnasal.” 

The results of the updated review are summarized in Table 2. 
Different features have been analyzed for each prototype, when available 
(Table 2): 
— interface; 
— tools under robotic control; 
— safety features; 
— set-up time and operative time (as compared to standard, nonrobotic). 


3.1 Robotic interface 


There are two types of interface: telemanipulation mode or “cooperative 
mode.” 

Telemanipulation mode is used to control endoscope positioners by, for 
example, voice, head motion, foot pedal, joystick (Trevillot et al., 2013b). 
Cooperative mode is an interesting alternative, in which surgeon and 
robotic arm cooperate side by side to hold the endoscope. In a cooperative 
mode, the surgeon manually moves the endoscope as in conventional sur- 
gery (Bolzoni Villaret et al., 2017), but the robot follows the motion of the 
endoscope and maintains it in position when the surgeon no longer holds it 
(Trevillot et al., 2013b). 

All described robots in this review are controlled in telemanipulation 
mode, except two of them (Table 2). 

The first one is an image-guided robot system described by Xia et al. 
(2008) developed to improve safety by preventing the surgeon from acci- 
dentally damaging critical neurovascular structures during drilling 


Table 2 Summary of the analyzed features for each prototype that has been described for endoscopic transnasal skull base surgery. 





First author (year of Set up time/ 
publication) Robot name Type of control interface Robotic task Safety operating time 
Nimsky et al. EVO1 Joystick (TM) Endoscope holder NR Long (30 min)/ 


(2004) 
Wurm et al. (2005) A73 Automatic robot 


Joystick (TM) 


Nathan et al. AESOP Voice control (TM) 
(2006) 

Strauss et al. (2007) — Joystick (TM) 

Xia et al. (2008) — CM 

Yoon et al. (2011) - Double joystick (TM) 

Eichhorn and Tx40 Joystick (TM) and 


Bootz (2011) autonomous tracking 
movements 
Swaney et al. - Surgeon’s console (TM) 


(2012) 


Neuroptik T30 
(Endoscope 
holder) 

Endoscope holder 


Endoscope holder 


Endoscope or drill 
holder 

Active bending 
spring 
backbone 
endoscope 

Endoscope holder 


Quadramanual 
robot: 2 
grippers, 
suction, and 
flexible 
endoscope 
with light 


source 


3D navigation system and 
“Loss of control” mode 


Three saved positions 


Integrated navigation 
system 
Easy switch to manual 
endoscopy 

Integrated navigation 
system 

NR 


Navigation system 


NR 


prolonged 
Long/prolonged 


Long (several 
minutes) / 
normal 

Short (2 min)/ 
prolonged 


Long/unknown 


Long/prolonged 


Unknown/ 
prolonged 


NR 
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Table 2 Summary of the analyzed features for each prototype that has been described for endoscopic transnasal skull base surgery.—cont’d 


First author (year of 
publication) 


Type of control interface Robotic task 


Safety 


Set up time/ 
operating time 





Trevillot et al. 
(2013a),b) 
Schneider et al. 

(2013) 


Cabuk et al. (2015) SP 


Swaney et al. 
(2015) 


Chan et al. (2016) 


Bolzoni Villaret 
et al. (2017) 


TENTACLE- Joystick (TM) 


Joystick (TM) 


The surgeon manipulates 
a user interface that 
controls the position 
and orientation of the 
robot manipulator 


Inertial measurement 
unit and vocal control 


Head control (marked 


Endoscope holder 


Instruments 
manipulator 
Endoscope holder 


One arm outfitted 
with a gripper 
and the other 
with an angled 
ring curette 


Endoscope holder 


Endoscope holder 


Force threshold 
NR 
Resistance felt on haptic 


arm in case of contact or 
friction with adjacent 


tissues 


Ability to change the axial 
orientation of the angled 


ring curette without 


changing the tip position 


or orientation of the 
robot 


Force threshold, vocal 


command 


Force threshold 


Long/unknown 
Unknown/normal 


Normal/ 
prolonged 


Unknown/ 
unknown 


Short (<3 min)/ 
normal (<7 min 
for maxillary 
antrostomy) 

Potentially limited 
set up time/ 
unknown 





Abbreviations: CM, cooperation mode; NR, not reported; TM, telemanipulation. 
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procedures. This system includes a modified N euroMate™ robot (Integrated 
Surgical Systems, Sacramento, CA) in cooperative control mode, 
StealthStation™ navigation system, 3D Slicer software for intraoperative 
visualization and workstation for application logic and robot control. The 
NeuroMate™ robot was modified converted into a cooperative robot by 
attaching a six-DoF force sensor (JR3 Inc., Woodland, CA, USA) at the 
end effector, between the final axis and the surgical instrument (Anspach 
eMax drill, Palm Beach Gardens, FL, USA). The disadvantages were the 
inaccuracy of about 1mm, due to an initial placement error, calibration 
issues, and robot kinematic inaccuracy (Trevillot et al., 2013a). 

The second one is a hybrid solution (HYBRID—compact, ergonomic, 
and safe endoscope positioner), which was developed as a combination of 
EVOLAP (a prototype built for minimally invasive laparoscopic surgery) 
and VIPER (a conventional six-active DOF industrial robot). The advan- 
tages of the hybrid prototype are active control of the penetration, intuitive, 
stable and safe motion, compactness, no interface between the right hand of 
the surgeon and the local manipulator. The drawback is that the rotation 
about the main endoscope axis is not controlled (Trevillot et al., 2013b). 

Most of the reported prototypes were joystick-controlled: 

— Evolution 1 (Nimsky et al., 2004) was initially designed as an endoscope- 
holding device for use in endoscopic ventriculostomy and then modified 
for transsphenoidal endoscopic surgery. It is a robotic teleoperation system 
controlled directly by the surgeon via a joystick and is based on a Stewart 
platform (hexapod design) with a seven axis (z-axis). The kinematic struc- 
ture of the hexapod allows movements in all six degrees of freedom and 
the workspace is increased by the additional z-axis. It was certified for 
actual patient use, but the presented system remains a prototype due to 
its relatively large dimensions; 

— A-73 (Wurm et al., 2005) is an automatic robot that allows the definition 
of the ideal trajectory on preoperative imaging, so during the procedure 
the remote-control unit allows the surgeon to correct a trajectory or com- 
plete an insufficient resection. Its major advantages are precision and 
multifunction, but the disadvantage is that it was not tested for any oper- 
ation except anterior sphenoidotomy and its large dimensions limit its 
potential clinical use (Trevillot et al., 2013a; Bolzoni Villaret et al., 2017); 

— Tx40 (Eichhorn and Bootz, 2011) is a robotic holder that performs auton- 
omous tracking movements, adjusted by a surgeon via a joystick. More- 
over, it is equipped with an automatic lens cleaning system. Even in this 
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case, the robot dimensions represent a major limit, as they limit the sur- 
geon’s range of movement; 

— the telemanipulated endoscopic holder dedicated to functional endoscopic 
endonasal surgery described by Strauss et al. (2007) presented a high accu- 
racy, was quicker and more accurate and precise than the human in posi- 
tioning the endoscope inside the nose, but was still judged inferior to the 
classic, nonrobotic set-up in most of the preclinical tests; the authors 
indeed stressed the importance of developing a man—machine interface 
to optimize endoscope maneuverability; 

— Stewart Platform (SP)-based robotic system (Cabuk et al., 2015) was 
developed as an endoscope positioner and holder that is able to change the 
position with the help of an assistant. The transsphenoidal sellar approach 
was possible with the endoscope holder attached to the Stewart platform. 
Stewart platform has a special structure with mobile and fixed plates, six 
linear motors and joints. The robotic endoscope holder allows the main 
surgeon to use both hands, optimizing also ergonomics during surgery. 
The robot is though controlled by an assistant with a joystick, with the 
difficulty of controlling at the same time both the operating area (i.e., 
the robot in its entry point) and the screen (where the endoscopic picture 
is projected); 

— a double joystick is needed to control the active bending of the endoscope 
prototype coupled with a spring backbone developed by Yoon and 
coworkers (Yoon et al., 2011), which was designed to be bent up to 
180 degrees. 

Most Authors indeed agree on the significant limitation of joystick- 
controlled telemanipulation: the technique implies the need for an added 
surgeon, who has to be extremely well coordinated with the primary sur- 
geon. None of these systems have been applied to transnasal surgery, possibly 
due to robots dimensions and the requirement of separate hand, by an assis- 
tant surgeon, to manipulate the joystick. 

Other types of telemanipulation have been suggested to overcome the 
limits of the joystick based one. 

Automated Endoscopic System for Optimal Positioning (AESOP) 
robot (Nathan et al., 2006) represents a voice-controlled prototype; its most 
interesting feature is the possibility to memorize certain positions, which 
could be returned to with a single voice command. It has seven degrees 
of freedom and supports continuous or incremental voice commands. How- 
ever, it only responds to easy commands thus not supporting complex com- 
binations of movement that are available in a free-hand technique 
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(Paraskevopoulos et al., 2016). The large working space occupied by the 
robot and its high cost prevents its use in routine surgery (Trevillot 
et al., 2013a). 

To further improve previous designs, the use of a foot-control was inves- 
tigated (Chan et al., 2016) (Foot-Controlled Robotic-Enabled Endo- 
scope—FREE) and its feasibility tested for functional endoscopic sinus 
surgery. FREE is controlled by an IMU (inertial measurement unit), the foot 
control interface, which is attached to the surgeon’s foot and communicates 
with the control unit via Bluetooth. This setup allows the measurement of 
the foot’s relative orientation in real time. Eversion or inversion of the foot 
changes the active joint in an increasing or decreasing manner. To provide 
the desired movement command to the active joint, the heel of the foot is 
raised to 15 degrees from the ground and moved left or right. 


3.2 Continuum robotics 


Other described prototypes for ESBS include continuum robotics, which 
use a new concentric tube technology. The use of these robots was a chal- 
lenge, because many degrees of freedom must be controlled simultaneously 
in a compact and unobtrusive package in the operating room. While signif- 
icant progress in designing these actuation units has been made for both 
larger, nonmedical continuum robots, and for certain types of surgical con- 
tinuum robots, the design of clinically relevant actuation units for concentric 
tube robots remains a comparatively understudied area of research, 
according to different Authors (Swaney et al., 2012). 

Some researchers (Swaney et al., 2012) designed a novel 24 degrees of 
freedom quadramanual slave robot, teleoperated for use in single-nostril 
transnasal skull base surgery. The robot is one component of a larger system 
that shall include a surgeon-controlled console conceptually similar to that of 
the da Vinci robot. In this system, a camera and three instruments has been 
included, to allow simultaneous use of two surgical tools with suction/irri- 
gation and a camera for visual guidance. The camera and instruments are 
mounted at the tip of concentric tube manipulators and they enable the sur- 
geon to visualize areas not otherwise seen with traditional endoscope while 
minimizing damage to healthy tissues. The same group (Swaney et al., 2015) 
recently added to the robotic system the ability to rotate the end effector 
while leaving the robot fixed in space. In the actuation unit, used to translate 
and rotate the tubes, each tube is grasped at its base and may be translated and 
rotated independent of the others, creating a tentacle-like motion. 
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Moreover, another author (Schneider et al., 2013) reported the func- 
tional requirements for an ideal robotic system for PSSB (paranasal sinuses 
and skull base) surgery, in which one instrument can be forwarded trans- 
nasally through a concentric tube, while being telemanipulated by the sur- 
geon (Friedrich et al., 2017). The many existing instruments designed for 
PSSB surgery can be adapted to the new technology by mounting them 
at the tip of this tube. This robot achieved “tentacle-like” motion and it 
was composed of several flexible, percurved tubes that are nested within 
each other. 


3.3 Hybrid robotics 


Bolzoni Villaret et al. (2017) recently described an additional hybrid proto- 
type, BEAR (Brescia Endoscope Assistant Robotic holder), developed and 
tested preclinically at the University of Brescia. To overcome the limits of 
commercially available systems, our group developed this hybrid solution, 
which is conceptually dissimilar from purely robotic surgery solution: the 
robotic system holds the endoscope, remaining entirely dependent on the 
surgeon, with a high safety standard, thanks to force feedback. This proto- 
type uses the surgeon’s head position to achieve an intuitive control of the 
movement of the robot-held endoscope. The system gathers the surgeon’s 
head position using an off-the-shelf optical sensor (Microsoft Kinect), which 
actually measures the position of two especially adapted glasses that must be 
worn by the surgeon (Figs. 1 and 2). A second version of the system has been 
designed more recently and uses Microsoft Kinect 2.0 sensor, which has 
higher precision and identifies the main surgeon’s shape even in operating 
room drapes, therefore eliminating the need for special glasses. BEAR shares 
with other systems the limits typical of a prototype, which was developed 
adapting an industrial robot, which had nonoptimal dimensions; further- 
more, during the preclinical tests other limitations became evident, such 
as suboptimal joint movements and excessive inertia (Bolzoni Villaret 
et.al.,, 2017). 





4 Clinical applications of robotics in transnasal 
endoscopic skull base surgery: Literature review 


Different prototypes have been described for endoscopic transnasal 
skull base surgery, with clinical applications limited to a robotic arm rest 
(Ogiwara et al., 2017) or to Trans-Oral Robotic Surgery (TORS) combined 
with Extended Endonasal Approach (EEA-~TORS) (Carrau et al., 2013). 





Fig. 1 BEAR at the Robotics laboratory of the University of Brescia. An industrial manip- 
ulator (Kawasaki RSO3N) was used: it is an anthropomorphic robotic arm with six rota- 
tional joints and six degrees of freedom. It was coupled with a force sensor: its 
transducer was positioned between the wrist and the endoscope holder (Bolzoni 
Villaret et al., 2017). (A, B) The robot holds the endoscope that has been positioned 
in a phantom (S.1.M.O.N.T°—Sinus Model Othorino Neuro Trainer by ProDelphus, 
Olinda, Brazil); the endoscopic screen shows the picture of the simulated left nasal cavity 
during the intranasal robotic navigation. 





Fig. 2 BEAR and its telemanipulation system. An optical system recognized the position 
of markers attached to glasses and therefore allowed the surgeon to move the endo- 
scope with intuitive head movements. (A-C) The surgeon is positioned away from the 
robot and the glasses are recognized by the system; (B) The movements of the surgeon’s 
head are recognized and the simulated endoscope [green tube (light gray in the print 
version) in D] is thus navigated inside the simulated nasal cavity. 
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Ogiwara et al. (2017) described an intelligent arm-support system, 
i-ArmS, developed as an operation support robot. It is controlled by force 
sensors, brakes, and encoders. There are two types of iArms: one for right- 
handed use and one for left-handed use. It follows the movement of sur- 
geon’s nondominant arm and fixes it at an adequate position. The system 
has three modes: transfer (Free), arm holding (Hold), and arm free (Wait). 
When the surgeon’s arm is placed on the arm holder, the mode changes from 
Wait to Hold. When the surgeon’s arm moves to the desired position and 
holds still, the mode changes from Free to Hold. The mode changes from 
Hold to Free with a click action by the surgeon’s arm. It has been designed to 
prevent hand tremor and to alleviate fatigue during surgery. It is therefore 
used as a robotic armrest for the surgeon. The authors reported on the appli- 
cation of this robotic device to endoscopic endonasal transsphenoidal sur- 
gery (ETSS) and evaluated their initial clinical experience in 43 patients 
in different surgical procedures. During the nasal and sphenoid phases, 
iArmS was used to support the surgeon’s nondominant arm, which held 
the endoscope. In these phases, the simultaneous use of two instruments 
was not essential, so two-hand technique with iArms was better than the 
use of a scope holder (reducing operation time and achieving excellent oper- 
ability). Then, during the sellar and reconstruction phases, its role was 
finished and a UniArm endoscope holder (Mitaka Kohki) was introduced 
and the scope was fixed to it. The intelligent armrest seemed to be safe 
and effective during ETSS. The main limit of the system is that it does 
not substitute the surgeon’s arm but is indeed an armrest. 

Carrau et al. (2013) described the EEA~-TORS approach, which was 
studied and practiced on cadavers, and then applied clinically to two patients. 
The EEA-TORS technique was used on human subjects to resect an ade- 
noid cystic carcinoma of the nasopharynx with extension both laterally into 
the infratemporal fossa and inferiorly below the level of the hard palate and 
resect a clival chordoma with extension into the craniocervical junction 
inferiorly to C2. Both patients had total resection with no complications 
and minimal postoperative morbidity. The EEA~TORS approach provided 
excellent exposure to the posterior skull base, nasopharynx, and 
infratemporal fossa. The main advantage of using this technique to manage 
skull base tumors is the ability to reach the posterior skull base below the 
level of the Eustachian tube, which is the inferior limit of the EEA, with 
TORS. This study, by an extremely experienced group, confirms the pre- 
sent limits of robotics, as the EEA phase was not performed with the robot. 
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5 A novel, commercially available hybrid system: Initial 
preclinical and clinical experience 


Endoscope Robot® by Medineering Surgical Robots” (Munich, 
Germany) has recently become available for clinical practice in endoscopic 
skull base surgery. It is a compact robot specifically developed to work as an 
endoscope holder during transnasal operations. As the product follows the 
same philosophy and fully develops the concept of BEAR, scientific collabo- 
ration was developed in 2016 with the company to test the system preclinically 
and possibly validate its use for endoscopic transnasal skull base surgery. 

The system is made of four components: a small, robotic, endoscope 
holder; the Positioning Arm; the control unit (foot pedal) and the power 
source (Fig. 3). The Positioning Arm is fixed directly to the OR table; it 
moves in every direction of space thanks to seven joints. Endoscope Robot™ 
is attached to Positioning Arm and holds and moves the endoscope. 

Endoscope Robot™ was tested for the first time in November 2016 on a 
cadaveric specimen in the Center for Anatomy and Cell Biology of the 
Medical University of Vienna and then in the Laboratory of Endoscopic 
Anatomy of the University of Brescia (Figs. 4 and 5). The first version 
was optimized for speed and type of movement. A commercially available 
surgical foot pedal was adapted to work as a robot manipulator (Figs. 3-5): 
the main surgeon can then control the robot with the foot pedal joystick 
(which moves the endoscope in a coronal plane), moving the endoscope 
in or out with the corresponding anterior pad. Foot pedal switches can 
be designed to return the robot to a saved position (“home position’) 
and to switch the joystick-controlled movement (i.e., rotation or translation 
of the optic). 

A first preclinical study has been recently performed to investigate the 
acceptance rate and possible benefits of Endoscope Robot™ for transnasal 
robotic-assisted endoscopic surgery (Zappa et al., 2019a). All (.e., attendees 
and faculty) skull base surgeons, Neurosurgeons, or ENT surgeons, attend- 
ing the Joint European Diploma of Endoscopic Skull Base Surgery 2018- 
2019 in Paris, were enrolled in the study in December 2018. 

Before the test phase, a questionnaire was administered to all participants, 
principally concerning personal surgical experience and habits. The test 
phase was structured in a 2-day session. A modified NeuroEndoTrainer 
(Singh et al., 2016), which is a low-cost training model that has been vali- 
dated for transsphenoidal surgery, was modified to allow for a bimanual task. 
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Fig. 3 Endoscope Robot® in the operating room at the University of Brescia. Once the 
patient is asleep, the robot holder is attached to the surgical bed and the surgeon can 
check the final position of the Endoscope Robot® attached to it. (A) The robotic arm and 
EndoscopeRobot® [red arrow (light gray in the print version)] before their positioning. (B) 
The foot pedal. (C) The robotic holder has been attached to the surgical bed; the sur- 
geon checks the positioning of Endoscope Robot®. (D) overview of Endoscope Robot® 
in a simulated surgical position before draping. 


Surgeons had to perform two different tasks with a 0-degree endoscope: the 
first one was a simple grasping task, while the second one was a relatively 
complex task, with the need of positioning a simulated nasoseptal flap over 
two pins. A tutorial video was shown to all participants before the tasks. Sur- 
geons had 3 min to get accustomed to the robot before performing the task 
with it. 

To control the effects of surgical learning, the participants were random- 
ized in two groups so that one group performed the task initially robotically 
and then manually, vice versa for the other. 

Participants will be evaluated with a modified GEARS-E score 
(Takeshita et al., 2018), which is an objective assessment tool in minimally 
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Fig. 4 Laboratory set-up at the University of Brescia (A) and of Vienna (B). The foot pedal 
is on the floor; the endoscope is held by Endoscope Robot and positioned inside the 
right nasal cavity of the specimen; the surgical field is displayed on a high definition 
(HD—3D and 2D, respectively) video screen. 


invasive surgery that comprises different domains representing various skill- 
related variables: 

— Endoscope control and depth perception; 

— Bimanual dexterity; 

— Tissue handling; 

— Efficiency. 

A 5-point Likert scale (i.e., 1 denotes the lowest proficiency, while 5 is the 
highest) was used to assess each domain. 

At the end of the test phase, a modified NASA-Task Load Index Test 
(Dixon et al., 2014) was conducted via “Survey Monkey,” in order to eval- 
uate the task load with a highly standardized tool. 

At the moment data analysis, including task execution time, GEARS-E 
score and the answers to the questionnaires, is still ongoing. Nonetheless, 
preliminary data analysis shows that most surgeons believe that robotic might 
provide a significant benefit in endoscopic skull base surgery, possibly prov- 
ing that many surgeons feel the need for a solution to the present limits of 
endoscope maneuverability. 

At the same time, the clinical study ROBOTHOLDER (RHOLD— 
Brescia Ethics Committee approval number: NP3080) has been initiated 
at the University of Brescia with the aim of prospectively evaluating efficacy 
and efficiency of this novel hybrid system (Figs. 3 and 6) (Zappa et al., 2019b). 
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Fig.5 Pictures from the first preclinical tests performed at the University of Brescia with 
a prototype by Medineering® (Munich, Germany). Surgical set-up was optimized and 
feasibility tests were performed in a model for transsphenoidal surgery (S.I.M.O.N. 
T®—Sinus Model Othorino Neuro Trainer by ProDelphus, Olinda, Brazil). 


RHOLD has a period of 20months (from September 2018 to April 2020) 
(Doglietto et al., unpublished data). 

The main objective is to evaluate the utility of robotic holder. The pri- 
mary outcome variable is the duration of the surgery (by comparison 
between patients operated with and without robotic holder, using historical 
comparison), in particular: 
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* duration of the robotic phase of surgery, comparing the recording with 
historical data; 

* duration of the surgical set-up phase, including the time required for the 
robot set-up, with comparison with data for surgery of the same type per- 
formed without robotic holder (historical comparison). 

The secondary objective is to evaluate the efficiency and utility of the 

robotic system in different endoscopic transnasal approaches. 
Study inclusion criteria are: 

* Patients undergoing endoscopic skull base surgery during the 
study period 

Study exclusion criteria are: 

* Minor patients and patients unable to provide consent. 

The study is ongoing and 21 robotic endoscopic transnasal procedures have 

been performed. Preliminary data document that surgical set-up is always 

<10min and can be performed during other surgical set-up maneuvers. 

The robot is compact and does not hinder the classic access to the patient; 

it can be prepared at the beginning of surgery and can be “stored” in a safe 

position before the robotic phase is commenced (Fig. 6). Subjective data 
include a significant advantage while holding angled endoscopes and when 

holding either endoscopes close to the target and in confined spaces (e.g., 

removing a craniopharyngioma during an extended, transtuberculum 


approach). 





Fig. 6 Clinical evaluation at the University of Brescia. In the nasal phase of surgery, the 
surgeon holds the endoscope and the robot is positioned at the patient's head, away 
from the surgical field (A). In the neurosurgical phase, the endoscope is held by Endo- 
scope Robot® and positioned inside the patient's right nasal cavity. The primary surgeon 
performs a bimanual procedure, while controlling the robot with the foot pedal (B). 
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6 Conclusions 


Many robotic prototypes dedicated to endoscopic skull base surgery 
have been described, but their application has been limited by large dimen- 
sions, inefficient control, and limited precision. Only recently, a hybrid 
robotic system has become available for clinical practice in endoscopic tran- 
snasal skull base surgery. Preclinical and clinical data are extremely promis- 
ing, but will need to be confirmed by further studies. 
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1 Introduction 


The term prosthesis is a generic name for any device that replaces a 
part of the body (Ramirez Garcia, 2011). With the Second World War came 
a technological upturn and with current technology, we have the possibility 
of making compact systems with physical characteristics close to the part of 
the body that needs to be replaced, and of using myoelectric signals for the 
voluntary control of prosthetic joints (Escudero Uribe, 2002). The first pros- 
theses had a purely aesthetic use. The new prostheses were designed and 
implemented to restore a percentage of the functionality of the lost limb, 
as well as “proprioception.” This was achieved using control techniques 
such as the use of EMG (electromyographic) signals (Moreno Pérez, 2010). 

Transhumeral prostheses currently on the market have two to three 
degrees of freedom (DOF), flexion-extension, pronation-supination, 
opening-hand closure, however, their human equivalent has between seven 
and eight DOF (Feng et al., 2005). The electromechanical actuators avail- 
able for commercial prostheses are assembled to work sequentially. This sim- 
plifies the control methods applied to the mechanisms. However, it limits 
the load capacity of the system. To solve this problem and try to increase 
the DOF of the prosthesis to improve its performance, the actuators are 
implemented in parallel (Grant, 2007). 

In the 1960s, the German company Otto Bock developed a myoelectric 
control for forearm prosthesis. In the same years, the Massachusetts 
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technology developed the Boston Elbow, a one DOF myoelectric elbow, 
later marketed by Liberty Mutual (Moreno Pérez, 2010). In the 1970s, 
the University of Chicago developed the Utah Arm, later marketed by 
Motion Control. In 2005, the American government organization Defense 
Advances Orthotics and Prosthetics Association (AOPA) announced the 
prosthetic research program “Revolutionizing prosthetics” (Moreno 
Pérez, 2010). 

Prostheses are classified as passive, those that only simulate in appearance 
the lost limb, but without any functionality other than its aesthetic appear- 
ance, and active prostheses, which provide functionality to the joints. This 
type of prosthesis is propelled by the body or batteries (Ramirez Garcia, 
2011). The higher the level of amputation, the more complex the prosthetic 
systems become, as well as the control method (Scott and Parker, 1988). 

A major challenge is related to the naturalness of the movements devel- 
oped by the prosthetic devices. In an active prosthesis, the more joints you 
have, the greater the number of inactive motors you will have. This repre- 
sents a load for the system because the motors that are not contributing to the 
movement generate an excess load to the system (Escudero Uribe, 2002). 
Commercial prostheses such as the Utah Arm and the Edinburgh Modular 
Prosthesis have a motor for pronation; however, that motor becomes a load 
for the bending motor (Jacobsen et al., 1982) (Gow et al., 2001). It is for this 
reason that prostheses that use parallel mechanisms allow the generated 
forces to converge in the same point or mechanical link (Escudero Uribe, 
2002). The DOF are determined by the amount of control signals that 
can be generated and coordinated voluntarily. The current prostheses on 
the market for amputations above the elbow have only up to three DOF 
(Escudero Uribe, 2002). The prostheses for amputations above the elbow 
work sequentially, that is, they cannot perform more than one simultaneous 
joint movement. An important challenge in the development of prosthetics 
is to achieve naturalness of movement (Ramirez Garcia, 2011). 

There have been several projects developed at the Bioelectronic Depart- 
ment at CINVESTAV-IPN in Mexico City related to the subject of EMG 
signal analysis for prosthetic control purposes. 

In 2002, the design and construction of a new prosthetic mechanic 
device was proposed to replace an up the elbow limb with parallel topology 
of linear actuators in which at least two actuators will work simultaneously in 
each one of the three active movements of the elbow, while the actuator that 
does not participate in the movement gives structural support (Escudero 
Uribe, 2002). 
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In 2003, a system for identifying seven hand movements from superficial 
electromyographic (SEMG) signals registered over the forearm was devel- 
oped (Leon Ponce, 2003). They use artificial neural networks (ANN) as clas- 
sifier to identify patterns that related the EMG signal with the final position 
of the hand. In 2012, a system was proposed for identifying 27 movements of 
the upper limb for the simultaneous control of three DOF of a virtual 
robotic arm (Leon Ponce, 2012). Using offline analysis of wrist movements 
using eight channels for acquisition, features from both time and frequency 
domain were extracted and three classifiers (linear discriminant analysis 
(LDA), ANN, and support vector machines (SVM)) were used. 

In 2010, a virtual training system was developed for the amputee to 
become familiar with a myoelectric control prosthesis (Barraza Madrigal, 
2010). This computer interface simulates an upper limb prosthesis for an 
above elbow amputee. It was developed in MATLAB™ and the control 
algorithm was generated froma single differential EMG channel from which 
three levels of force were defined. The user was able to practice and identify 
each of the force levels generated by the contraction of the remaining muscle 
in his or her stump by receiving a visual feedback from the interface. In 2016, 
an ambulatory system was developed for the analysis of upper arm move- 
ments (Barraza Madrigal, 2010). This system provides information referring 
to the position and orientation of the upper limb, due to the shoulder rota- 
tion. This system makes it possible to monitor, reproduce, and follow the 
movement of the shoulder articulation; this is done by measuring the range 
of the movement described by the upper limb during its active elevation. 

In 2010, the design and construction of a movement control system was 
proposed for a trans-humeral prosthesis with four active DOF (Moreno 
Pérez, 2010). The control hardware consists of four “cycloconvertors 
circuits,” a “power board,” and a “main board,” with an embedded 16 bits 
DSP microcontroller. 

In 2011, an automatic system to decompose myoelectric signals was 
developed using wavelets analysis and support vectors machines for classifi- 
cation processes (Marquez Lazaro, 2011). This system was able to classify the 
signals when a simulated noise was added. 

In 2011, an upper limb prosthesis was proposed, the movement of which 
would use actuators with a set of angles measured during different activities, 
such as drinking water, waving the hand, answering the phone, opening a 
door, and serving a glass of water from a jar (Ramirez Garcia, 2011). 

In 2012, a prototype of an artificial hand was proposed with five DOF, 
with anthropomorphic and anthropometric dimensions able for grasping 
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and moving a handle (Altamirano Altamirano, 2012). The author proposed a 
modular prosthesis that can be attached to different types of prostheses and 
connectors. The work is based on the anatomical and biomechanical features 
and functions of the hand to perform grasping movements performed by the 
fingers. In 2017, the author proposed a process to analyze multichannel 
sEMG signals using wavelet transform, Hilbert-Huang transform and 
methods like Kalman and Goertzel filters as techniques to detect, measure, 
filter, and decompose these sEMG signals to identify patterns in time, fre- 
quency, space, or a combination, for flexion-extension movements of the 
fingers of the hand using link-fingers superficial muscles in order to predict 
hand movements and with this, reduce computing time (Altamirano 
Altamirano, 2017). 

In 2014, a novel classification of upper limb movements was proposed 
by analyzing the transient state of the muscle contraction using Hjorth’s 
parameters (Pla Mobarak, 2014). With this proposal they manage to iden- 
tify movements with classification accuracy higher than 95%, suggesting 
the existence of highly relevant info in the dynamic part of the muscle con- 
traction as to be able to propose myoelectric control schemes from its 
analysis. 

In 2015, developed an active electrode was developed capable of acquir- 
ing superficial EMG signal in a different way using a double reference pro- 
posal for noise suppressing (Ruvalcaba Granados, 2015). 

In 2017, an ambulatory system was developed for analyzing the move- 
ment of an upper limb (Contreras Rodriguez, 2017). The author designed 
and fabricated sensing cards involving inertial sensors and a DsPic for data 
acquisition and processing. They also implemented a radio frequency 
(RF) communication to send the data between each one of the sensing 
cards—this in order to establish it as an ambulatory system. 

In this chapter, a review of several works developed in the bioelectronic 
department at CINVESTAV-IPN in Mexico City is described. These works 
aim to develop a novel ambulatory active electrode for superficial EMG sig- 
nal acquisition systems in order to obtain a robust database of the forearm 
signals while doing wrist and fingers movements in order to produce cleaner 
and faster signal processing. A work related to feature extraction using 
Hilbert-Huang transform and Kalman and Goertzel filters as classifiers in 
order to obtain prediction of several fingers’ movements is reported. These 
researches have the aim of reducing the time consumed since the signal 
acquisition until the signal interpretation, and thus, reduce the delay that 
a prosthesis takes to respond to a command. 
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2 Process of prostheses control 


In this section there are described many different types of prosthetic 
devices developed for the replacement of an upper limb. In addition, there 
are described some control strategies that regulate the movement of these 
prostheses that use sEMG. 


2.1 Type of prostheses 


The prostheses are classified into two types: active prostheses (with indepen- 
dent energetic capacity); and passive prostheses (they require muscle energy 
to function) (Moreno Pérez, 2010). 

They can also be classified based on their functions and characteristics: 

- Cosmetic prosthetics: This is a type of passive prosthesis. Its main function 
is “cosmetic restoration,” and is usually constructed of PVC, latex and/or 
silicone. The functionality of this type of prosthesis is limited and has a 
short lifespan (Moreno Pérez, 2010). 

- Body powered: This type of prosthesis uses harnesses and cables and the 
device is controlled through the movement of the body. 

- Electrical: In this type of prosthesis the joints are activated by small electric 
motors controlled by myoelectric signals generated during a muscular con- 
traction of the remaining limbs. 

- Hybrid: This type of prosthesis combines the use of electric motors with 
the harnesses and straps used in body powered. 


2.2 Types of prostheses control 


There are several forms of control for active prostheses: 

- Body power: They are the simplest control options, controlled by cables. 
This type of control requires a great effort for action, but in turn provides 
“proprioceptive” feedback. Through cable control, terminal devices and 
active elbows can be controlled (Doeringer and Hogan, 1995). 

- When using electrically driven prostheses with myoelectric control, the 
user is free of straps and harnesses. 


2.3 Protocol for prosthesis control using sEMG signals 


The effectiveness of classification algorithms based on EMG signals and pat- 
tern recognition is based on an effective implementation of three modules 
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that should be considered when selecting an optimal vector of characteristics 

(Ruiz-Olaya et al., 2015): 

- preprocessing; 

- feature extraction; and 

- pattern classification. 

The implementation of an algorithm for pattern recognition based on the 

EMG signal has the following difficulties (Ruiz-Olaya et al., 2015): 

- The EMG signal is variable in time and highly nonlinear. 

- The EMG signal is highly affected by noise, such as ECG cross-talk, elec- 
tromagnetic induction of the line, and movement of the cables and the arm 
(movement artifacts). 

- There are factors such as interference of surrounding muscles, physiolog- 
ical conditions (fatigue), and impedance of the skin, among others. 

- The level of activity of each muscle for a certain movement is different for 
each individual. 

The sEMG signal can be used to activate or continuously control some 

external assistance devices including prosthesis and electric orthoses 

(Farina and Negro, 2012). The control of a device through EMG can be 

achieved through two main types of sEMG signal processing (Song et al., 

2013): 

- Data-driven machine learning: The idea is to associate a desired control 
command or some observed action with the underlying EMG signal pat- 
terns (Farina et al., 2014; Matrone et al., 2012; Muceli et al., 2014). 

- Model driven approach: Uses the superficial EMG signal as input for spe- 
cific, physically correct models of the skeletal muscle system. 

These are used to reconstruct all neurophysiological and musculoskeletal 

transformations from the beginning of the EMG signal to the body function. 





3 Electrodes for sEMG signals acquisition 


In this section, different types of electrodes (wet and dry) used in the 
sEMG signal recordings are presented. A method is proposed for the design 
and testing of an active electrode sensor for the acquisition of sEMG signals 
using dry electrodes. 


3.1 Types of electrodes 


There are two main types of electrodes used to detect the electromyographic 
signal: surface and insertable (needle). 
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3.1.1 Surface electrodes 

There are two types of surface electrodes: passive and active. Passive elec- 
trodes consist of a conductive surface that detects the current in the skin 
through the electrode/skin interface. The main characteristic of active 
electrodes is that they have an electronic amplifier with high input 
impedance in the same housing as the electrodes. A basic example of a 
passive electrode consists of a silver disk attached to the skin. By using 
conductive gel, the electrical conductivity at the electrode/skin interface 
is improved. 


Passive electrodes 

There are two types of electrodes: perfectly polarizable and perfectly non- 

polarizable. This refers to what happens to an electrode when a current flows 

between it and the electrolyte. 

- Perfectly polarizable: those in which no load crosses the electrode/electro- 
lyte interface when a current is applied. The electrode behaves like a 
capacitor. 

- Perfectly nonpolarizable: those where the current passes freely through the 
electrode-electrolyte interface, without requiring energy to carry out the 
transmission. 

The silver/silver chloride electrode (Ag/AgCl) is a perfectly nonpolarizable 

electrode, consisting of a metal covered with a layer of ionic compound 

poorly soluble in this metal with a suitable anion. The solution is immersed 
in an electrolyte containing the anion in a relatively high concentration 

(Webster, 2009). 


Active electrodes 

For many years, systems for biopotentials based on dry electrodes have been 
developed and marketed (Burke and Gleeson, 2000). However, these can be 
polarized and have a high impedance at the electrode/skin interface, causing 
variation in contact electrode resistance and polarization potential (Zipp and 
Ahrens, 1979). The wet Ag/AgCl electrodes have a variable impedance 
between 1 and 100 kQ (Huigen et al., 2002; Grimnes, 1983). This imbalance 
is produced when the common mode voltage present in the body interferes 
with the differential measurement, and an interfering differential voltage 
occurs due to currents coupled by electromagnetic interference (EMI) from 
the cables (Huhta and Webster, 1973). This problem can be solved using 
active buffers of unitary gain connected directly to the dry electrodes; this 
produces a high input impedance in the electrodes and low output 
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impedance to drive the coupled currents to ground, avoiding the use of 
meshed cables (Fernandez and Pallas-Areny, 1997; MettingVanRyjn et al., 
1996). 


3.1.2 Electrodes configuration 

The electrical activity on the surface of the skin is acquired by placing an 
electrode with a single detection surface with respect to a reference electrode 
located in an electrically neutral zone. This type of electrodes is known as 
monopolar, used in the clinical area due to its simplicity. This configuration 
has the disadvantage of detecting any signal adjoining the electrode, includ- 
ing unwanted signals. 

The bipolar configuration compensates for this limitation; in this case, 
two electrodes are used to detect two potentials in the muscle of interest, 
each one with respect to the reference electrode. Subsequently, the two sig- 
nals are fed to a differential amplifier, which will amplify the difference of 
both signals thus eliminating any common mode component. In the clinical 
setting, the skin is often degreased using cotton wool with alcohol before the 
placement of the electrode, which helps to remove some of the dead, loose 
cells external to the stratum corneum and lipid substances of low conduc- 
tivity on the skin surface (Chi et al., 2010). When a wet gel for electrodes 
is applied to the skin, previously cleaned with alcohol, the gel penetrates the 
degreased skin quickly, once the electrode has been in contact with the skin 
for several minutes, causing a rapid decrease in the impedance of the skin and 
a decrease of movement artifacts (Xu et al., 2017). 


3.2 Active electrodes 

3.2.1 Introduction 

The failure of a chemical equilibrium in the metal/electrolyte junction causes 
a polarization potential, which affects the amount of current flowing to the 
electrode. The active electrodes were developed to eliminate the need to 
preprepare the skin and the conductive medium. These electrodes are also 
known as dry or paste-less electrodes. These electrodes are not reliable for 
long-term acquisition because their dielectric properties are susceptible to 
change due to the effects of perspiration and to erosion of the substance of 
the dielectric. To improve the prediction of activation and muscle strength 
using sEMG signals, it is important to reduce unwanted variabilities, so that 
real muscle activity can be best represented by the acquired signals. Previous 
research has contributed to the optimization of technical aspects, instrumen- 
tation (Clancy et al., 2002; Godin et al., 1991; Klijn and Kloprogge, 1973; 
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Nishimura et al., 1992; Webster, 1984), and of appropriate filtering techniques 
(Webster, 2006; Clancy and Hogan, 1995). 

Like the myoelectric prostheses, a good signal acquisition, even cleaning 
it at the moment of processing it, depends on the electrodes and the type of 
electrode used and a system that delivers EMG signals in a clean way and 
with good amplitude. When designing an electrode, the electronic 
processing device is usually the first to be developed, whereas the electrode 
design for the sensing is left to the end, this is a design error (Coughlin and 
Driscoll, 1987). It is important that the acquired signals are clear, without 
distortion, and free from artifacts. When monitoring the electrodes, if they 
are not carefully chosen, this will cause significant problems, which make the 
signal obtained difficult to analyze (Coughlin and Driscoll, 1987). 

A serious problem occurs due to the change of the contact impedance 
due to the frequency. The dependence of the frequency on the contact 
impedance is a consequence of the parasitic capacitance at the electrode/ 
electrolyte interface (Coughlin and Driscoll, 1987). The electrode/skin 
impedance is highly affected by the preparation of the skin and is inversely 
related to the surface of the electrodes. Rubbing the skin with abrasive sur- 
gical soap is, without a doubt, the best treatment to reduce the electrode/ 
skin impedance; rubbing with alcohol is not very effective. Electrode noise 
is generally the most important source of noise in the EMG signal register 
and is, therefore, the limiting factor for detecting very small potentials 
(De Luca et al., 2006). Noise is affected by the treatment of the skin. A small 
abrasion of the skin or epilation with adhesive cloth reduces electrode/skin 
impedance, noise, DC voltages, and movement artifacts (De Luca et al., 
2006). 

Some wearables systems for the acquisition of superficial EMG signals use 
conductive gel to have a better conduction at the electrode/skin interface. 
Some other authors develop their own dry electrodes, to avoid the constant 
use of gel; however, they still use a commercial system for data acquisition 
(DAQ). Other authors have recently developed novel flexible electrodes, 
coupled to a flexible acquisition system. However, the manufacture of these 
devices is still very complex and expensive. 


3.2.2 Dry electrodes 

In 2015, a dry brass electrode was designed (Ruvalcaba Granados et al., 
2015); due to its low level of oxidation (Perry et al., 1997) this is a good 
conductor and, because it is a base material, to be plated in gold for future 
use. A dry electrode is proposed due to the limitations and disadvantages that 
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Fig. 1 Machined brass electrode. 


derive from the use of wet electrodes, such as signal distortion in sEMG sig- 
nal acquisitions for long periods of time; this is because the electrolytic gel 
begins to dry, causing the quality of the acquired signal to become deficient 
over time. 

The proposed dry brass electrode is shown in Fig. 1. The electrode is 
machined from a brass bar of 9.6 mm in diameter; the head has a thickness 
of 1.5 mm anda 2 cm long by 0.5 mm in diameter stem (this stem is used to 
connect it to the acquisition board). 

The electrode/skin impedance of the brass electrodes was measured by 
the 3-electrode method (Salazar Munoz, 2004). This measurement was also 
made with the Ag/AgCl electrodes in order to compare the result with a 
commercial wet electrode. The measurement frequency range varies from 
5 to 2 kHz. The results are shown in the graph of Fig. 2. 

The highest impedance in the Ag/AgCl electrodes is observed in the 
lowest frequency and its value decreases as the frequency increases. Its 
impedance range is from 134 kQ—5 Hz to 3.33 kQ—2 kHz, having an imped- 
ance of 10.54 kQ at 450 Hz, which is the cutoff frequency of the system. As 
for the brass electrode, it has an impedance range of 220 kQ-5 Hz at 4.32 
kQ—2 kHz and having an impedance of 14.81 kQ at the cutoff frequency of 
450 Hz. The values obtained for the brass electrodes, which are very close to 
those obtained in the Ag/AgCl electrodes, showing good electrode/skin 
impedance. 

In 2017, conductive cloth electrodes were used as dry acquisition 
sensors, with dimensions of 20 mm of diameter and distribution of three 
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Fig. 2 Relationship of the response of the impedance to the frequency of the Ag/AgCl 
and brass electrodes. 





electrodes along the long palmar muscle in a row, with an IED (inter- 
electrode distance) of 25 mm (Fig. 3) (Ruvalcaba Granados et al., 
2017a, 2017b). 


3.2.3 Signal acquisition system 

Signal acquisition systems are used in sports medicine to measure and mon- 
itor the performance of athletes in order to improve their physical perfor- 
mance. It is also used to measure the evolution in the increase of the 
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Fig. 4 Circuit board of the EMG acquisition system. 


strength of contraction and resistance to fatigue of the muscles and, in this 
way, to corroborate the progress, success, or failure of a specific sports train- 
ing plan, or for a plan of rehabilitation after an injury. 

In 2014, the electronic design ofa system for acquiring sEMG signals was 
proposed (Fig. 4) (Ruvalcaba Granados et al., 2014). Two INA128UA 
instrumentation amplifiers were used in cascade due to their high common 
mode rejection rate (CMRR)—120 dB—and cascaded to not saturate the 
amplification, of 100 and 10, respectively. An active high-pass filter in inte- 
grator configuration is used, whose feedback is connected to the INA128 
reference terminal to reduce the offset voltage. The cut-off frequency of 
the filter is calculated at 20 Hz. The next circuit is a low-pass, second-order 
filter, Sallen-Key type of unit gain with a cut-off frequency calculated at 400 
Hz. After the buffer follows a passive filter of first-order passes high, with a 
cutoff frequency at 0.05 Hz for electrode coupling with the skin. The acqui- 
sition system is powered with +9 Vcd by two rechargeable 9 V batteries of 
1300 mAh. The first electrodes used to test the system and acquire the elec- 
tromyographic signal were disposable wet electrodes for the 3M brand elec- 
trocardiogram. A differential acquisition is used to obtain the corresponding 
muscle signal between two electrodes. For the configuration of the reference 
electrodes, a proposal is used to place them near the acquisition electrodes, in 
order to suppress the noise to the acquisition electrodes and suppress the 
noise that surrounds the muscle section that is to be sampled; this configu- 
ration is shown in Fig. 5. 
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Fig. 5 Electrodes array proposal. 
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Fig. 6 (A) Signal acquired at the longus palmar muscle during a strong contraction. 
(B) Signal acquired at the longus palmar muscle during a light contraction. 





Fig. 6A and B shows the recording of two types of signals to verify the 
correct operation of the sEMG signal acquisition system. Two differential 
electrodes of the long palmar muscle and two reference electrodes were 
placed at 90° to the acquisition electrodes. Using an oscilloscope, two types 
of signals were recorded: a light contraction (slight flexion of the wrist) anda 
strong contraction of the muscle (strong flexion of the wrist). 

Using a signal generator and an oscilloscope, the CMRR of the com- 
plete sEMG signal acquisition system was measured. Fig. 7 shows a final ver- 
sion of the first circuit board developed, changing all electronic components 
for surface components. This is done with the purpose of reducing the noise 
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Fig. 7 Final design of the EMG acquisition system using surface elements. 


of the signal induced by the terminals of the electronic components. By using 
surface-mounted devices, it helps to reduce the size of the electronic circuit, 
in this case, going from an 8 cm x 6 cm board to a 3 cm diameter board. 
In 2017, the authors added to the acquisition system a noninverting 
amplifier adder to send the negative part of the EMG signal to positive 
and thus be able to transmit the complete signal (both the negative and 
the positive part) to the A/D converter (Fig. 8) (Ruvalcaba Granados 
et al., 2017a). They added a 2.2 Vdc voltage to the input of this system. 





Fig. 8 sEMG acquisition system with miniaturized electronics. 
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The output of this circuit is the input of an amplification stage with a gain of 
2, before being sent to the A/D converter to compensate for the loss of 
amplitude due to the adder. 

The manufacture of a circuit for the transmission of data is also described. 
An ATMEGA328-P microcontroller is used for A/D conversion and serial 
transmission with the computer. A USB-serial driver FT232-RL is also used 
to make the serial connection through the USB port. The system is powered 
by two 9 V batteries (£9 V) and the microcontroller by a +5 V battery. 

Figs. 9 and 10 show two signals corresponding to a wrist flexion, 





Ag/AgCl electrodes and conductive fabric electrodes, placed in the long 
palmar muscle. This to compare the signals obtained with the new dry elec- 
trode and a commercial wet electrode. The CMRR of the signal acquisition 
system was also measured, obtaining a CMRR of 94 dB. 

In A. Ruvalcaba et al., using the circuits and electrodes described in the 
previous work (Ruvalcaba Granados et al., 2017a), the authors recorded on 
the computer—using the acquisition system described in (Ruvalcaba 
Granados et al., 2017b)—and compared the signal obtained when per- 
forming an elbow flexion, with the electrodes connected to the biceps 
(Ruvalcaba Granados et al., 2017b). The signals obtained between the 
dry electrodes of conductive fabric and the commercial wet Ag/AgCl 
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Fig. 10 Long palmar muscle response to a wrist flexion using Ag/AgCl wet electrodes 
wearable system. The signal has a 2.2 Vdc offset in order to send it by the analog input to 
the microcontroller. 


electrodes are compared, observing that it is possible to use the dry electrodes 
of conductive fabric to acquire EMG surface signal. However, they produce 
an offset at the time of recording the signal, which is seen in Fig. 11; this 
offset is corrected with postprocessing techniques. 
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Fig. 11 Elbow flexion registered at the bicep muscle using (A) wet electrodes and (B) dry 
electrodes. Raw signal and normalized signal. 
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3.2.4 Active electrodes developed 

By using dry electrodes on unprepared skin, the impedance of the electrode/ 
skin interface becomes relatively high and variable, making them susceptible 
to EMI. This problem can be solved by an electronic design. The base signal 
obtained using dry electrodes takes more time to stabilize. This problem is 
solved by using active electrodes. 

In 2015, a new acquisition system was designed, where the high passive 
filter of 0.05 Hz is eliminated because this filter does not contribute substan- 
tially to the cleaning of the signal, and removing it from the circuit saves 
space and electronic noise by decreasing components (Ruvalcaba 
Granados et al., 2015). The circuit board developed with the electronics pre- 
viously described uses only surface mounted devices (Fig. 12). The circuit 
board measures 3.5 cm in diameter and 2 cm in height. A plastic housing 
was designed and built to carry and protect the system. A threaded housing 
was designed to reduce the size of the housing and ensure a good seal with 
the acquisition system. 

To establish that the acquisition system is working correctly and that the 
signal delivered to the output of the circuit is a valid EMG signal without 
noise, the CMRR of the system is measured. The CMRR obtained from 
the system is 116 dB; way above what is established by the International 





Fig. 12 Final stage of the electrodes integrated to the sEMG signal acquisition system. 
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Society of Electrophysiology and Kinesiology (ISEK) standards. The actual 
cutoff frequency is obtained, calculated according to the commercial resis- 
tance value implemented, using Eq. (1). 


= — = 416.7H 1 
k= 750.7e)(01p) m) 
A frequency sweep is performed to obtain the response of the system, graph- 
ically observing the real cutoff frequency, when the signal drops to —3 dB 
(Fig. 13), obtaining a real cutoff frequency of 450 Hz. 

The system is powered by two 11 Vdc batteries to have a bipolar voltage. 
The current consumed by the device is 17.2 mA. The batteries have a load 
supply of 1000 mAh, therefore, calculating the discharge time, the device 
can operate for 58 h continuously. 

An EMG signal of the muscular response of a wrist flexion was acquired 
with the system connected in the long palmar muscle; the signal quality and 
its amplitude can be observed in Fig. 14. 

Finally, the characteristics of the developed system are compared with 
a similar commercial system (Delsys, 2018) in Table 1, obtaining similar 
characteristics in CMRR, type of acquisition, and input impedance, the 
difference between both systems is the material used in the sensing 
electrodes. 
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Fig. 13 Frequency response of the low-pas filter. 
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Fig. 14 Signal obtained from a high contraction from the palmar muscle using the brass 


electrodes integrated to the sEMG acquisition system. 


Table 1 Comparison of specifications between the system proposed by A. Ruvalcaba 
et al. and the Bagnoli™ commercial system. 








Specifications Proposed system Bagnoli® 
Mechanical 
Type Single differential Single differential 








Number of contacts 2 2 

Contact dimensions 2mm xX 9 mm diameter 10.0 x 1.0 mm diameter 

Contact spacing 20 mm 10 mm 

Contact material Brass 99.9% Ag 

Detection area 29 mm? 10 mm? 

Case dimensions 35 mm diameter X 20 mm 41 x 20 x 5 mm 
height 

Case material ABS Polycarbonate 

Electrical 

Bandwidth 0-450 Hz + 30 Open 

CMRR 116 dB 100 dB 

Power consumption 17.2 mA 20 mW 


Input impedance 
Sensor contacts 


Sensor dimensions 


>10'° Q/0.2 pF 

4 brass round electrodes 
2mm xX 9 mm diameter 

30 mm diameter 


>10'° Q/0.2 pF 
2 silver bars 

10mm x 1 mm diameter 
19.8 mm x 5.4 x 35 mm 
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4 Superficial EMG (sEMG) signals 


This section talks about the basics of the superficial EMG signals such 
as frequency range and amplitude of the signals. Further, the state of the art 
regarding feature extraction and classifiers meant to recognize hand move- 
ments is reported. In addition, a novel method for feature extraction 
(Hilbert-Huang transform) and a hand movement classifier is described 
(Goertzel and Kalman filters). 


4.1 Introduction 


Although a muscle can contain hundreds or thousands of motor units, the 
muscle fibers of a motor unit are not adjacent to each other but intermingled 
with the muscle fibers of other motor units; however, they contract and 
relax in parallel, thanks to the action potential generated in the myoneural 
junction by the impulse of the nerve fiber (Ramirez Garcia, 2011). The 
sEMG signal is a complicated signal, which is affected by the anatomical 
and physiological properties of the muscles, the control scheme of the 
peripheral nervous system, and by the characteristics of the instrumentation 
used to detect and observe it (Basmajian and De Luca, 1985). 

The electromyographic signal has become a fundamental tool to achieve 
control of artificial limb movement, functional electrical stimulation and 
rehabilitation (Castellanos Abrego, 1997). The interpretation of the instruc- 
tions received by the muscles from the nervous system to induce movements 
are useful for the development of artificial elements such as prostheses and 
orthoses (Altamirano Altamirano, 2017). sEMG signals provide ample infor- 
mation about muscle activity in a noninvasive way; this information is really 
useful as a source of control. sEMG signals are very noisy. This noise may be 
due to the electronic system, or due to interference from electromyographic 
sources (Altamirano Altamirano, 2017). 

The raw EMG signal is processed mainly to extract information regard- 
ing the amplitude of the signal [root mean square (RMS), average rectified 
value (ARV), and linear envelope (LE)] and its spectral power density (Fou- 
rier or autoregressive approximations). The mean and median frequency 
(MNF and MDF) are obtained from the spectral power density (Merletti 
and Farina, 2016). These parameters of the sEMG, provide information on 
the muscular contraction force and the frequency content of the signal. 
Processing the signal means applying algorithms to extract parameters 
or characteristics, which will be used for some purpose such as signal 
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classification or quantification of changes. The estimation of the amplitude of 
the sEMG signal is used as the input in the control of myoelectric prostheses. 

In the frequency domain, the dominant change in the EMG signal, dur- 
ing a high effort and sustained contraction, is a compression of the signal 
spectrum towards lower frequencies. The measurement of this compression 
is related to muscle fatigue. In the time domain, the dominant changes in the 
single-channel EMG signal are: (a) the modulation of the standard deviation 
of the signal (RMS) and (b) spectral changes due to muscular effort and/or 
fatigue. The spectral changes can be evaluated in the time domain with sim- 
ple techniques, based on counting the zero crossings of the signal or in the 
analysis of peaks (Merletti and Farina, 2016). 


4.1.1 EMG signal bases 

The electromyographic signal is the electrical manifestation of the neuro- 
muscular activation associated with an order of muscular contraction. 
The signal represents the current generated by the ionic flux through the 
membrane of the muscle fibers, which propagates to the surface of the elec- 
trode, which is the sensor of this EMG signal. The amplitude of the EMG 
signal ranges from 50 pV to 20-30 mV. The value of the amplitude of this 
biopotential is proportional to the intensity of the contraction (Merletti 
et al., 2003). The frequency range in which the EMG signal is located ranges 
from 20 to 450 Hz (Paul et al., 2014). 


4.2 sEMG signal processing 

4.2.1 Introduction 

One of the areas where pattern recognition has recently been applied is in 
biomechanics, mainly in the detection of EMG signals that produce natural 
muscle movements in a person; these signals are used in the control 
of artificial devices that mimic natural movement (Leon Ponce, 2003). This 
involves pattern recognition based on the acquisition, analysis, and 
processing of the signal generated by the muscles in contraction (Miller 
et al., 2008; Huang et al., 2008; Hargrove et al., 2009; Chu and Lee, 
2009; Simon et al., 2011; Fougner et al., 2011). The raw EMG signal has 
a lot of noise. This type of signal can be very useful when it is correctly ana- 
lyzed, quantified, and classified (Basmajian and De Luca, 1985). 

In biomedical applications, the acquisition of the signal is not enough. It 
is required to process the acquired signal to obtain the relevant information 
buried in it. This is because the information of interest is not visible inside 
the signal (Bronzino, 1999). A large number of signal processing methods are 
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available, and to correctly select an algorithm, one must know the objective 
of the processing, the test conditions, and the characteristics of the signal 
(Bronzino, 1999). Recent advances in technology for signal processing 
and mathematical models have allowed the development of advanced tech- 
niques for the detection of EMG signals and their analysis. 

Several mathematical techniques and artificial intelligence (A.I.) have 
received great attention. Some mathematical models include the wavelet 
transform (WT), time-frequency approximations, Fourier transform (FT), 
Wigner-Ville distribution (WVD), statistical measurements, high order sta- 
tistics, and Hilbert-Huang transform (HHT). Some artificial intelligence 
approaches for signal recognition include ANN, dynamic recurrent neural 
networks (DRNN), and fuzzy logic systems (FLS). Genetic algorithms (GA) 
have also been used for the mapping of EMG entries for desired hand move- 
ments. Some methods, such as mean frequency (MNF), median frequency 
(MDF), peak frequency (PKF), median power (MNP), spectral moments 
or spectral frequency variance, are not good for classifying EMG signals 
(Phinyomark et al., 2011). 


4.2.2 Signal processing techniques 

In 2017, a novel proposal for the analysis of sSEMG signals was reported, 
obtained from the forearm muscles for the prediction of flexion and 
extension movements of the fingers, in order to reduce the computation 
time (Altamirano Altamirano, 2017). The proposal consists of the use of 
wavelets and Hilbert-Huang transformations, as well as the use of signal anal- 
ysis methods such as Kalman and Goertzel filters, used to detect, measure, 
filter, and decompose these signals and thus achieve the identification of 
movements. 

The generation of a database is started here, placing Ag/AgCl surface 
electrodes on five muscles of the forearm for registering the movements 
of the subject’s fingers. Using a four channel electrode array, these signals 
are sampled and recorded. Subsequently, the signals are normalized and pre- 
viously visualized when analyzed. A database of six finger movements was 
obtained. The BIOPAC MP35 acquisition system with four channels was 
used to acquire the EMG surface signals from five healthy volunteers. 
The signals for the database were recorded using the software BLS PRO- 
321111.7 with a sampling frequency of 2 kHz and a gain of 1000. The 
BIOPAC system has an integrated filter IIR Chebyshev 2 of sixth order 
selected for a frequency range of 10-500 Hz. Each channel has a differential 
acquisition based on instrumentation amplifiers with an external reference. 
The signals of six finger movements were obtained: (1) flexion of the index 
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finger, (2) flexion of the middle finger, (3) flexion of the ring finger and little 
finger, (4) flexion of the thumb, (5) closing the hand, and (6) opening 
the hand. 


Normalization of the processed signals 

Normalization is fundamental in every method of signal processing. The 
normalization is done by obtaining the o factor, which is reciprocal to 
the maximum absolute value of the myoelectric signal in each channel, in 
a sampling of 1000 ms. See Eq. (2). 


Veg = mas) tS 1p. = >; i=1,...,4i 





= No.of channels (2) 


The muscle intensity level was recorded and compared with the six move- 
ments. Three intensity levels were established: high intensity (0.7—-1 V); 
average intensity (0.35—0.65 V); and null intensity (0—0.3 V). Fig. 15 shows 
the intensity map for user 1. 
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Fig. 15 Muscular contraction intensity of subject 1 for four channels versus six move- 
ments of the fingers. The map shows the intensity present in the four channels when a 
movement was performed: the star represents the 0.7—1 V level, the dot represents the 
0.35—0.65 V level, and the circle represents 0—0.3 V. Each icon represents one of nine 
repetitions. 
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4.2.3 Feature extraction methods 

With respect to stationary analysis, this consists of the methods and processes 
proposed to analyze the data recorded using transformed wavelets and 
Hilbert-Huang (Altamirano Altamirano, 2017). 


Wavelet transform analysis 

For the processing of EMG signals, the wavelet transform is an alternative for 
another time-frequency representation. While wavelet transformation pro- 
vides a flexible time-frequency resolution, it suffers from a relatively low res- 
olution in the high frequency range. The comparison was made with 
scalograms obtained with a Daubechies 44 wavelet (Fig. 16) and a Meyer 
wavelet (Fig. 17). This comparison shows that the Meyer wavelet has a bet- 
ter definition in time and frequency than the Daubechies 44. 


Hilbert-Huang transform analysis 

The purpose of the EMD (empirical mode decomposition) is to decom- 
pose a multicomponent signal (as the myoelectric signal) into a number 
of mono-components called IMFs (intrinsic mode functions). The EMD 
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Fig. 16 Scalogram of CBA4_234 obtained with Daubechies 44 Wavelet. 
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Fig. 17 Scalogram of CBA4_234 obtained with Meyer Wavelet. 





signal processing technique is suitable for filtering the EMG signal. The 
great disadvantage of the EMD method is that it is more sensitive to the 
presence of noise. Fig. 18 shows the signal sEMG and its IMFs of a single 
channel related to the flexion and extension of the fingers (Altamirano 
Altamirano, 2017). 

For EMD, using the first normalization, the number of IMFs obtained 
was between 8 and 19 per channel. For the second standardization, between 
5 and 11 IMFs were obtained. Subsequently, the Hilbert-Huang transform 
and the instantaneous frequency were applied to each IMF obtained from 
each channel. The resulting data are shown in Fig. 19. The instantaneous 
envelopes are used to obtain the instantaneous frequencies of each IMF. 
The ranges of these frequencies result in 105-310 Hz. The instantaneous 
frequency is useful for locating significant changes in signal energy, for 
example, voluntary contractions and relaxation. 

The main frequencies of the IMFs are in the order of 200 + 20 Hz, 
detected in the first IMFs. The low frequencies detected in the first IMFs 
were 12, 8, and 6 Hz. The detected high energy frequencies are a group 
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Fig. 18 sEMG signal and its IMFs of Channel 3, related to the flexion and extension of all 
fingers. Six levels of decomposition are shown. IMF 2 shows two motor unit action 
potentials (MUAPs) in 50 ms and approximately 100 ms. 


of AM/FM signals with average frequencies of 83.3 Hz (73.57—-85.9 Hz), 
96.7 Hz (94.35-99.82 Hz), 59 Hz (58.5-61.3 Hz), and 113.3 Hz (111- 
117.04 Hz). By analyzing the resulting instantaneous frequencies, it is pos- 
sible to identify changes in the first four IMFs, which are related to the acti- 
vation of the flexion movement. 








4.2.4 Classification methods 

During the nonstationary analysis of the signal it is expected to find the con- 
ditions, methods, techniques, and processes to perform in short-time, or less 
than 100 ms of real-time processing, using Kalman and Goertzel filters to 
identify the characteristics or patterns of the signal myoelectric. The Kalman 
filter improves noise cleaning and reconstruction to predict the input signal. 
The output of the Kalman filter goes to the Goertzel filter, which detects 
specific signals using the DFT in the patterns of the model. The results of 
these filters could be applied directly to a prosthetic system as a control signal 
or be applied to a classification system, depending on the complexity of the 
acquisition system, channels or movements. 
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Fig. 19 Hilbert transform of IMFs for Channel 2 during supination movement in transient segment. 
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Kalman filter 

In Altamirano’s proposal, after the acquisition stage, for real-time applica- 
tions, it is necessary to decode the information present in the sEMG signal. 
The author proposed filtering the signal to achieve this purpose (Altamirano 
Altamirano, 2017). Specific filtering algorithms are required to clean the 
noise of the signal to be treated. To reduce the computational cost of the 
identification process, a system for predicting states in the filtering process 
is necessary in order to make advanced decisions about the behavior of mus- 
cle activity. To use the Kalman filter, a representative model in the form ofa 
state space is required (Fig. 20A and B). This model consists of a process 
equation and a measurement equation. 


Goertzel filter 

If the specific frequencies of the standard signal are known, then the Goertzel 
filter is able to recognize these frequencies instantaneously. In the same 
way, a rapid myoelectric identification can be made to detect a specific 


Simulated sEMG 





Kalman filtering 
response 


Real sEMG 
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(B) Time (ms) 
Fig. 20 Kalman filter responses in simulated and real sEMG signals. (A) Simulated 
sEMG signal (red line—gray line in print version) is fitted with the math sEMG model 


established in the filtering parameters. (B) Real sEMG signal (black line) is fitted with 
the math sEMG model settled in the parameters. 
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Fig. 21 Periodogram of the PSD estimated with FFT for Xpattern Signal without noise. 


movement. The Goertzel filter uses the known frequency values of the stan- 
dard signal to identify the frequencies present in an input signal within a time 
window. If the known frequencies match one or more of these, then the 
filter responds. Using fl, 2, and f3, of Xpattem, the Goertzel filter was applied 
to an input x [n]. 

Fig. 21 shows a periodogram of Xparem[{t] input signal without noise for 
the spectral density power (SDP) present in the signal. This periodogram was 
calculated using the fast Fourier transform (FFT). The three frequency com- 
ponents, 83.3, 96.7, and 113.3 Hz are detected. Fig. 22 shows the discrete 
Fourier transform of the signal Xparrem Without noise. The density of each fre- 
quency component is different, related to the weight of the sinusoidal 
component. 

A new methodology proposal was described for signal processing for the 
extraction of characteristics of the raw sEMG signal and to obtain an iden- 
tification and prediction of the movements of the fingers of the hand 
(Altamirano Altamirano, 2017). The wavelet transform is useful for the 
detection of motor unit action potentials (MUAPs) in the presence of white 
noise. The novel proposal for the extraction of characteristics through the 
use of the Hilber-Huang transform helps to find intrinsic characteristics of 
the sEMG signal in real-time applications, by identifying the main frequency 
components involved, in this case, in the movements of the fingers. 

By using the Kalman filter the noise is reduced and it provides a fast 
reconstruction of the desired shape of the reported pattern. Finally, the 
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Fig. 22 Discrete Fourier transform of the Xpattern signal without noise obtained by the 
Goertzel algorithm. 


Goertzel filter provides a simple method of identifying the frequency pat- 
terns in less than 5 ms, only to locate the desired frequencies. The consump- 
tion time for the identification, detection, prediction, and correction of the 
myoelectric signal can be completed in less than 100 ms. The compendium 
of this proposal developed is summarized in Fig. 23. 





5 Discussions 


In the content of this chapter, A. Ruvalcaba proposes an electronic 
system that acquires the sEMG signal using dry brass electrodes with an 
in-line arrangement in parallel with the muscle fibers of the forearm. Finally, 
the acquisition device is validated by assuring its operating values are keeping 
with the ones that the SENIAM (Surface ElectroMyoGraphy for the Non- 
Invasive Assessment of Muscles) proposed for sEMG signal acquisition 
devices, measuring a CMRR of 96, a signal amplitude of 0.5—2 Vp-p, a fre- 
quency bandwidth of 20-450 Hz, and a high impedance input. The elec- 
trode/skin impedance ranges from 220 kQ at 5 Hz to 4.32 kQ at 2 kHz. 
These values are similar between each other, establishing that our electrodes 
can be used to acquire sEMG signals according to the standards described by 
the AAMY. These signals will be used to generate a database that is processed 
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to obtain characteristics that can identify movements of the wrist in a short 
time to subsequently control a physical prosthesis. 

This work is complemented with the research carried out by Alvaro 
Altamirano where he describes and proposes the next phase, which is to per- 
form the control of a myoelectric prosthesis by processing the sEMG signals 
in order to find a feature that can represent each movement. In this novel 
proposal he makes the identification of movements of the fingers of the hand 
by using the Hilbert-Huang transform, which decomposes multicompo- 
nents signals into a number of mono-components (IMFs). Using the instan- 
taneous envelopment, the instantaneous frequencies of each IMF are 
obtained. By analyzing the resulting instantaneous frequencies (83.3, 
96.7, 99.82, 59, and 113.3 Hz) it is possible to identify changes in the IMFs, 
which are related to the activation of flexion movement. Later he proposes 
the use of Kalman and Goertzel filters for the identification of these frequen- 
cies and thus, obtain a system capable of predicting the movements that, 
computationally speaking, manages to make the identification of these 
movements in something less than 80 ms. 





6 Conclusion 


The purpose of a myoelectric limb prosthesis, or a part of it, is to return 
lost function. A prosthesis is not only aesthetic, it must be functional, the user 
must be comfortable, and finally, it must allow the user to integrate into the 
labor market. One of the problems with robotic prostheses is the slowness in 
their action, producing frustration in users when they cannot be used in daily 
life. The investigations described in the previous work attack this problem 
from two fronts. The work carried out in the LAREMUS laboratory in the 
bioelectronics group of CINVESTAV-IPN, is focused on solving the 
response speed of a superior limb prosthesis. The regulation of the move- 
ment is intended with the voluntary EMG signal of the user, with the iden- 
tification and prediction of the desired movement in less than 80 ms, sending 
the activation code of the desired movement to the biomechanical system 
(prosthesis). Each movement will have an activation code and an established 
sequence to produce this movement. 

The first investigation described tries to solve this by improving hard- 
ware and sensors for the acquisition of superficial EMG signals. To acquire 
the muscular signal that moves a prosthesis during the day, it is necessary to 
stop using wet electrodes of electrolytic gel and it is necessary to use dry elec- 
trodes for the acquisition. Now, to be able to use the dry electrodes as sensors 
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for the acquisition of sEMG signals it is necessary to use another type of hard- 
ware for the amplification and interpretation of the signals, before they are 
transmitted to store and process them, or to be already implemented in a 
myoelectric prosthesis. 

In the research described by A. Ruvalcaba et al., a novel system proposed 
for the acquisition of sEMG signals is shown. This system improves the qual- 
ity of the signal since its acquisition stage, avoiding costly postprocessing 
time that worsens the prediction time of the movement that the prosthesis 
should identify and perform. 

As a work in the future, this signal identification and prediction system 
needs to be implemented, both in a virtual prosthesis and later in a real pros- 
thesis to verify and demonstrate its true effectiveness in the use of everyday 
prostheses. It is expected to improve computational cost time and thus the 
prediction and anticipation of movements that are expected to be performed 
using a myoelectric prosthesis with voluntary movements that mimic the 
characteristics of natural movements. 
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1 Introduction 


Biological research mainly aims to discover, understand, and utilize 
the law oflife activity. With the evolution of life, biological structures evolve 
from simple single-cell organisms into a wide variety of complex life indi- 
viduals. To protect life activity from external damage, organisms evolve out 
ofa relatively closed and independent environment, that is, the in vivo envi- 
ronment. This environment provides a stable condition for life operation, 
resulting the in increasingly complex form of life. A closed in vivo environ- 
ment provides protection for our lives but has hindered our research on life 
activities. The in vivo environment is difficult to observe and control 
because of technological restrictions. To address this limitation, scholars 
opt to conduct in vitro experiments. However, the in vivo condition is dif- 
ficult to completely simulate in vitro, regardless of improvements in in vitro 
experiments, because the organism is a complex whole. 

With the development of science and technology, advance tools and 
techniques have emerged to help us observe and control in vivo environ- 
ments. Such technologies are vital for in vivo explorations. Optical tweezers 
(OTs) are a new but effective tool used to control in vivo environments. 
OTs, also known as optical trap, use a highly focused laser beam to trap 
and manipulate microscopic, neutral objects with noncontact force. This 
tool can be used to noninvasively manipulate cells in living animals. The first 
in vivo manipulation experiment with OTs was reported in 2013. Zhong 
et al. (2013a,b) used infrared OTs to trap and manipulate red blood cells 
(RBCs) within subdermal capillaries in living mice. In this experiment, 
RBCs in the capillary at the depth of ~40 ym beneath the surface of mouse 
ear skin was manipulated to block and clear the capillary to simulate the for- 
mation and removal of thrombus. OTs can not only be used as an operating 
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tool but also as a mechanical measurement tool. In Johansen et al. (2016), 
OTs were used to analyze adhesion properties and membrane deformation 
in endothelium and macrophages in a living zebrafish. Overall, OTs exhibit 
potential for various applications, including studies on cancer metastasis 
mechanism (Gupta and Massagué, 2006; Clevers, 2011; Oskarsson et al., 
2014; Reya et al., 2001), eliminating thrombus (Zhong et al., 2013b), 
targeted drug delivery (Forbes et al., 2003), screening of nanoparticle-cell 
interactions for cancer therapy (Tan et al., 2012), and research on tissue inva- 
sion in cancer and infection biology (Wu et al., 2011). Although OTs are a 
promising tool, their applications are hindered by many factors. Manual 
operation limits the handling of biological particles in complex in vivo envi- 
ronments, which are subject to various disturbances and uncertainties. With 
manual control, human operators encounter difficulty in retrieving cells 
once they escape from the OTs. The cells rapidly move away from the blood 
flow, and human operators cannot quickly find the lost cells. Manual control 
is also difficult considering the presence of disturbances, uncertainties, and 
collision avoidance problem in vivo. 

The limitations of manual control can be addressed by robotics technol- 
ogy. An automated robot-aided OTs system integrates robotics with OTs 
manipulation to achieve fast, stable, and efficient manipulation of micropar- 
ticles. Robot-tweezer manipulation is widely used in in vitro manipulation 
tasks, including cell transportation (Thakur et al., 2014; Chowdhury et al., 
2014; Hu and Sun, 2011b; Banerjee et al., 2012; Ju et al., 2014; Li et al., 
2015b), cell pairing (Xie et al., 2015), cell sorting (Chapin et al., 2006), 
and cell assembly (Tanaka et al., 2013). However, OTs with robotics tech- 
nology have been rarely used in vivo. Hence, studies of in vivo robot-aided 
OTs system can develop the potential of OTs in in vivo research and exhibits 
important implications for biomedicine. 

In this chapter, an automated cell transportation system that integrates 
robotics and OTs technologies is introduced. This system can automatically 
identify, capture, and transfer single cells in in vivo environments. In order 
to increase the success rate of transportation, the disturbance of blood flow in 
blood vessels and collision with free cells are considered. Disturbance com- 
pensation and obstacle avoidance functions of the transportation system are 
developed. The effectiveness of the proposed system is verified by 
transporting red blood cells in living zebrafish. 

The remainder of this chapter is as follows. In Section 1, the background of 
the in vivo manipulation is introduced, including the dynamic model of 
microparticles in blood vessels and the mechanical properties of OTs. 
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Section 2 shows the identification and tracking methods for in vivo particles 
used to construct a visual feedback control system. Section 3 presents the 
position control system ofin vivo microparticles that use OTs to drive micro- 
particles from one location to another in blood vessels of living zebrafish. Two 
kinds of position controllers are introduced in this section. To solve the col- 
lision problem between the controlled particles and the free cells in the in vivo 
transportation process, a collision avoidance method called collision- 
avoidance vector methods is showed in Section 4. Section 5 summarizes 
the content of this chapter and looks forward to future work. 


1.1 In vivo environment 


The blood vessels are a part of the circulatory system that transports 
blood throughout the body. Blood delivers necessary substances, such as 
nutrients and oxygen, to the cells and transports metabolic waste products 
away from the same cells. As an important system of the body, the blood 
vessels have been extensively studied (Cohen and Taylor, 2002; Pries 
et al., 2000; Davies et al., 1997). Therefore, the internal environment of 
blood vessels has been studied in this chapter as the main environment 
for cell transport in vivo. 

In this chapter, zebrafish was selected as experimental model to conduct 
cell transport experiments in its blood vessels. Zebrafish is an important ver- 
tebrate model organism in scientific research. Zebrafish has become a pop- 
ular model system because its embryos and larvae are small, transparent, and 
undergo rapid development ex utero, allowing in vivo analysis of embryo- 
genesis and organogenesis. In cardiovascular research, zebrafish is used to 
model blood clotting, blood vessel development, heart failure, and congen- 
ital heart and kidney diseases (Drummond, 2005). Zebrafish also represents a 
common cancer model system used in cancer research (Evensen et al., 2016; 
Teng et al., 2013; Stoletov and Klemke, 2008). Fig. 1 shows a 30-hour- 
postfertilization (hpf) zebrafish. 

To control RBCs in the blood vessels, the mechanical properties of these 
cells must be study first. When blood flows in microcirculation, several 
features are observed: low Womersley number, low Reynolds number 
(Re), pulsating fluid, and interaction between RBCs and blood vessels. 
These features differentiate in vivo and in vitro cell manipulation. 

Low Re is similar to that in in vitro manipulation. Re is a dimensionless 
quantity used to predict similar flow patterns in different fluid flow situa- 
tions. This parameter is defined as the ratio of inertial forces to viscous forces 


284 Xiaojian Li and Dong Sun 








Fig. 1 The image of 30-hpf zebrafish. 


and quantifies the relative importance of the two types of forces for given 
flow conditions. Re is defined as 
_pyD _ uD 


Re ) (1) 
H V 





where D is the hydraulic diameter of the pipe, vris the mean velocity of the 
fluid (SI units: m/s), is the dynamic viscosity of the fluid [Pas or Ns/m* or 
kg/(ms)], p is the density of the fluid (kg/m’), and v is the kinematic vis- 
cosity (v=y/p) (m7/s). The Re of microcirculation systems is very low. 
For example, the Re in dogs are as follows: 





Arterioles Re=0.09, 
Capillaries Re=0.001, 
Venules Re=0.035. 





When Re <1, the viscous forces are larger than the inertial forces. The rela- 
tionship between force and speed of motion is provided by Stokes’ law 
(Dusenbery, 2009). 

Stokes’ law is illustrated as follows: 


F,=—67uR»,, (2) 


where F, is the frictional force, also known as Stokes’ drag, which acts on the 
interface between the fluid and the particle (N); R is the radius of the spher- 
ical object (m); and », is the velocity of the particle (m/s). 

Womersley number (a) is a dimensionless number in biofluid mechanics 
and expresses pulsatile flow frequency in relation to viscous effects. This 
parameter is defined as (Womersley, 1955): 
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Table 1 Womersley numbers in different human blood vessels. 














Vessel Aorta Artery Arteriole Capillary Venule Veins Vena cava 
Diameter (m) 0.025 0.004 3x 10° 8x10-° 2x10~° 0.005 0.03 
a 13.83 2.21 0.0166 4.43x10-° 0.011 2.77 16.6 
7) Local inertial force 
a=, = . ? (3) 
V Viscous force 


where 1, is the radius of the blood vessels, and @ is the angular frequency of 
the oscillations. When aris less than 1 and the frequency of pulsations is suf- 
ficiently low, the velocity distribution along the radial direction of the blood 
vessel is parabolic. The blood flow velocity near the blood vessel wall is slow, 
and the blood flow velocity in the central region 1s fast. In addition, the flow 
will be very near in phase with the pressure gradient. 

A list of estimated Womersley numbers in different human blood vessels 
is shown in Table 1. 

When a<1, the heartbeat-induced oscillations and the local inertial 
force can be negligible. Therefore, the velocity and pressure of blood can 
be regarded as constant in microcirculation systems for a period of time. 

Because of the low Womersley number and Re, the force balance equa- 
tion of RBCs can be written as follows: 


ApS+F,+F,=0 (4) 
Substituting Eq. (2) into Eq. (4) provides 


_ ApS+ F, 


=— 5 
i 67pnR ©) 


where Ap is the average pressure difference across the RBC, and S is the 
sectional area of the RBC. 

The pressure difference A p is usually zero in vitro and can be negligible. 
However, A p plays an important role in promoting blood flow. Although this 
parameter is constant within a short period of time, the pressure significantly 
changes under prolonged period. Pressure difference is affected by many fac- 
tors, such as positional relationship between RBCs and blood pressure 
changes. Therefore, A p must be considered when cells are controlled in vivo. 

When the cells flow freely with blood, the force of the OTs F,=0. 
According to Eq. (5), the following equation can be obtained: 


ApS = 6mpRv;, (6) 
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where 7 is the blood flow velocity. Substituting Eqs. (2), (6) into Eq. (4), the 
dynamic equation can be written as follows: 


F,-— 6muUR(v, _ v1) =0 (7) 


1.2 Optical tweezers 


Optical tweezers (OTs), also known as optical trap, use a highly focused laser 
beam to trap and manipulate microscopic, neutral objects with noncontact 
force. Since their development four decades ago, OTs have been widely 
employed for actively manipulating and positioning biological objects at 
the nano/microscale. Arthur Ashkin performed the first optical trapping 
experiment over 40 years ago (Ashkin, 1970); in this study, particles align 
themselves and move along the axis of the beam through a phenomenon 
commonly known as optical guiding. This year marks the 25th year since 
the inception of the popular version, namely, “optical tweezers” (Ashkin 
et al., 1986). Currently, OTs are commercially available and applied partic- 
ularly in biological sciences (Molloy and Padgett, 2002). For example, twee- 
zers are used to measure the compliance of bacterial tails (Block et al., 1989), 
evaluate forces exerted by motor proteins (Finer et al., 1994), stretch DNA 
molecules (Wang et al., 1997), and manipulate biological cells (Li et al., 
2015a; Chowdhury et al., 2014; Hu and Sun, 2011a; Zhang and Liu, 2008). 

Scattering and gradient forces exerted on the particles depend on the 
wavelength of the laser beam (A) and particle size (r). Particles trapped by 
the OTs can be divided into three regimes, namely, Mie regime (r> 4); 
Rayleigh regime (rA); and regime in between them (rA) (Ashkin and 
Dziedzic, 1987). In different regimes, the principle of trap force varies. In 
this study, the transportation of cells, with size ranging from 5 to 40m, 
is focused. Therefore, only the Mie regime should be considered. In this 
regime, the trap force of the OTs can be due to changes in the optical 
momentum. The object often exhibits higher refractive index than that 
of water. The laser beam is refracted from the water into the object, and 
the direction of the laser beam changes, leading to momentum change in 
the laser beam. According to momentum conservation, the amount of 
change in momentum produces force acting on the object. In this principle, 
force caused by the OTs will pull the target to the area of high-light intensity 
for spherical objects. According to Hu and Sun (2011b), the trap force on a 
3-m yeast cell was measured. Fig. 2 shows the relationship between the lat- 
eral trapping force and the offset when the OTs is forced on a yeast cell. 
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Fig. 2 Example of yeast cell: lateral trapping force versus lateral offset (Hu and 
Sun, 2011b). 


The offset is the distance from the center of the yeast cell to the center of the 
laser beam. The trapping force increases as the offset increases, in an approx- 
imately linear relationship, until the offset is larger than ro, and then decreases 
to zero as the offset increases. 

Trap force on spherical objects can be approximated by the following 
equation: 


F, = kord,, \|d,|| < %, (8) 


where F, is the trap force, d, denotes the offset from the center of the yeast 
cell to the center of the laser beam, kor is the stiffness of OTs, and 19 is the 
escape radius. 

With the development of technology, HOTs have been proposed to 
flexibly generate multiple OTs and control their position with a computer 
(Curtis et al., 2002; Wang et al., 2006; Wulff et al., 2006; Fournier et al., 
2008). HOTs use a computer-designed diffractive optical element (DOE) 
to split a single collimated laser beam into several separate beams; each beam 
is focused into an OT by strongly converging lens (Dufresne et al., 2001; 
Dufresne and Grier, 1998). As originally demonstrated with microfabricated 
DOEs (Grier, 1998), HOTs are implemented with computer-addressed liq- 
uid crystal spatial light modulators (SLM) (Reicherter et al., 1999; Liesener 
et al., 2000). Projecting a sequence of computer-designed holograms 
reconfigures the resulting pattern of traps. 

In general, OTs exhibit the following advantages: noncontact force, 
active or passive force clamp, well-defined geometries, and few material 
requirements and this can be used to control one or more objects flexibly. 
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Few scholars have confirmed that OTs can be used to manipulate cells 
in vivo. Zhong et al. (2013a,b) and Johansen et al. (2016) reported the 
use of OTs to manually manipulate in vivo cells in mice and zebrafish, 
respectively. 

Zhong et al. (2013a,b) reported the first experiment of trapping cells in 
living animals in 2013; in this in vivo cell manipulation with OTs, RBCs in 
living mice were transported to produce or eliminate thrombosis. In general, 
RBCs in capillaries flow at a speed of 0.1-2 mm/s. RBCs are trapped in a 
capillary at ~5 pm (and ~15pm) diameter observed at depth of ~40 um 
(and ~45 ym) beneath the surface of mouse ear skin. At deep locations in 
the mouse ear (~60 Um), OTs cannot trap cells because of two main reasons. 
First, the trapping force is reduced significantly by the loss of laser power at a 
deep location. Second, an appropriate gradient force might not exist to hold 
the cells because of severe aberration in focusing through thick tissues. The 
experiment confirmed that cells can be manipulated in vivo with OTs. 

Johansen et al. (2016) reported the optical micromanipulation of 
nanoparticles and cells in living zebrafish in 2016. In this study, different cells 
and the injected nanoparticles and bacteria can be trapped; as such, adhesion 
properties and membrane deformation of endothelium and macrophages 
can be analyzed. This noninvasive micromanipulation inside an entire 
organism provides direct insights into cell interactions that are inaccessible 
using existing approaches. This technique can be applied in screening 
nanoparticle-cell interactions for cancer therapy or tissue invasion studies 
in cancer and infection biology. This study shows that the manipulation abil- 
ity of OTs in zebrafish is more powerful than that in mice because the trans- 
parent zebrafish tissues minimally affect laser projection. 





2 Identification and tracking of microparticles in vivo 


The movement of cells in vivo is difficult to predict because of distur- 
bances and uncertainty in in vivo environments. Automatic in vivo cell 
transport 1s impossible to realize with an open-loop controller. The cell posi- 
tion must be identified in real time to build a close-loop control system for 
in vivo cell transport. The image signal is the main output signal of most 
in vivo imaging tools, such as charge-coupled device (CCD), optical coher- 
ence tomography, ultrasound, MRI, functional near-infrared spectroscopy, 
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and radiography. Information on cell position should be extracted from the 
in vivo image with image processing. In this section, an image processing 
module is designed to identify and track the target cell based on the 
in vivo image captured by the CCD camera. 


2.1 The identifying of fluorescently labeled microparticles 


Precise measurement of cell position is necessary to an in vivo control sys- 
tem. In contrast to in vitro application, the image showing an in vivo envi- 
ronment is chaotic. Fluorescently labeled cells are easier to identify than 
nonfluorescently labeled cells. The labeled cells show a different color from 
the background, which makes the cell easy to be segmented. Here, cells 
labeled by green fluorescent protein were injected into a 30-hpf zebrafish 
and observed by the OTs system. 

As shown in Fig. 3A, an image of the fluorescently labeled cells obtained 
through a CCD camera can be denoted as a matrix O(k)€ RM*? 


Cell radius R. 


ey) 


Optical tweezers Cell position p. 


Destination 








280 290 300 310 320 330 340 350 360 370 
X (pix) 


Fig. 3 (A) Original image of the fluorescently labeled cell. (B) Fluorescently labeled cell 
area after binarization. (C) Vector graph of the direction [— Mx, My)". (D) Detection of the 
fluorescently labeled cell. 
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constituted by Wx H vector elements 0,.,(k) = [0,,y,-(R), 0x,y,0(R) ox,y,(k)], 
where 0,,(R), 0x,y,0(k), and ox,y4(k) denote the red-green-blue (RGB) 
intensity value of the pixel located at (x,y). kE N is the frame number. 
W and H are the width and height of the image, respectively. 
Fluorescently labeled cell image can be obtained through threshold seg- 
mentation. The image of the fluorescently labeled cells in Fig. 3B can be 
denoted as N(k)€ R*"*', with vector elements that can be obtained as 


follows: 


1, ox, y,r(k) = T; or ox,y,o(k) > Ty or ox,y,o(k) = T, 
nal ={ Parl ) y.b( ) b vel ) £ (9) 


where T,, T,, and T, are positive thresholds for red, blue, and green, respec- 
tively; and n,.,(k) denotes the intensity value of the pixel located at (x, y) in 
new image. In Eq. (9), the original image can be binarized. n,.,(k) = 1 is the 
white area or the fluorescently labeled cell area, and n,.(k) =0 is the black 
area or the tissue area. 

The area of fluorescently labeled cells has been separated. Based on this 
phenomenon, cell detection will become easy. 

First, the contour of the area should be extracted by using edge detection 
operators (Nixon and Aguado, 2012). A vector graph of the direction 
[— Mx, My]" as shown in Fig. 3C can be obtained by the convolution of 
the binarized image using the Sobel operator. The contour of the fluores- 
cently labeled cell can be extracted by selecting any point of the edge on 
the vector graph (that is, the nonzero point) and searching along the direc- 
tion [— Mx, My]. The process can be achieved using the cvFindContours 
function in OpenCV. 

Second, the external rectangle of the cell contour should be determined. 
After contour extraction, a set of contour pixels can be obtained. Based on 
these pixels, we will calculate the center and radius of the cell. We will 
determine the smallest x, the smallest y, the largest x, and the largest y in 
the contour pixels, which are expressed as Xnins Ymins Xmax> ANd Vmax, TESpec- 
tively. The external rectangle can be formed by four lines, which are 
X=Mmin, Y=Ymins X=Xmax, ANd y=Ymax. The measured cell position is 


T 
denoted as p.= [Pa B.| , where p,.=(%min +%mx)/2 and 


Poy = min + ymax) /2. The measured cell radius can be obtained by 





lo ico —Xmin )(Ymax — Ymin)/2- In this way, the fluorescently labeled 
cell is detected as shown in Fig. 3D. 
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2.2 The identifying of the nonfluorescently labeled 
microparticles 

Images of nonfluorescently labeled cells are difficult to distinguish from tis- 
sue images compared with fluorescently labeled cells. Therefore, the non- 
fluorescently labeled cell is difficult to extract from a single frame. 
Fortunately, the tissue image is always stable and can be regarded as a back- 
ground. The moving nonfluorescently labeled cells can be separated from 
the stable background and identified. 

An image of the nonfluorescently labeled cells is obtained through a 
CCD camera (Fig. 4A). After comparison between the two adjacent frames 
(frames k—1 and k), the stable area image, which is the same in the both 
frames, can be extracted by the following equation: 








Fig. 4 The step of background segmentation. (A) Original image. (B) Extract the same 
area between adjacent frames. The black area is the different part. (C) The extracted 
background. (D) The image after background segmentation. The white area is the mov- 
ing cells. (E) The detected moving cells with a blue circle (gray circle in print version). 
(F) The tracked cell with a green center (gray dot in print version). 
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0x, )(R), 
1(0={ ( | 








0x, y(k) — Ox, (k= 1)|| < T 


; (10) 
0x, (Rk) — 0x, y(k— 1)|| >T 


0, | 





where s,.,(k) denotes the RGB intensity value of the stable area image, and T 
is the positive threshold. Fig. 4B shows the stable area image, in which the 
intensity of the black areas is zero, representing the moving area. The intensity 
of the remaining areas is the same as the frame k, representing the stable area. 


The image background in Fig. 4C can be denoted as B(k) ¢R™*”*° 
with vector elements that can be expressed as follows: 
_ J rb, ,(R-1) +(1—T)s, (Rk), $x,)(k) 0 
besl= Cele) abo | 
b.. (0) = 1, (12) 


where b,.,(k) denotes the intensity RGB value of the background, and T is 
the forgetting factor between 0 and 1. 

Comparison between the original image O(k) and the background B(k) 
shows that the image of the moving cells in Fig. 4D can be denoted as N(R), 
and vector elements can be obtained as follows: 


where T, is a positive threshold. 














In this manner, the image of the moving cells can be obtained. However, 
the moving cell image is more messy and trivial than the image of fluores- 
cently labeled cells. The image of the moving cells is thus difficult to be iden- 
tified by the introduced method in Section 2.1. Therefore, a different 
method is necessary to identify moving cells. 

As shown in Fig. 4, the RBCs of zebrafish before 48 hpf show a regular 
spherical shape. HT is a commonly used algorithm for identifying arbitrary 
shapes and can be used to identify moving cells (Ballar, 1981). 

First, the edge of the moving cells can be obtained by the convolution of 
the binarized image with edge detection operators. The edge of the moving 
cells should be formed in a circle. 

The equation of the curve can be provided in explicit or parametric 
form. In explicit form, HT can be defined by considering the equation 
for a circle given by 


(x — Pex)” + (x-py) =r (14) 
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This equation defines a locus of points (x, y) centered on an origin (p.., Pcy) 
and with radius r,. This equation can be visualized in two ways as follow: as a 
locus of points (x, y) in an image and as a locus of points (p,x, p-y) centered on 
(x, y) with radius r,. 

According to Eq. (14), HT mapping is defined by 


Pex = x — 1,c08 (f) 
eee i) 


where y € (— a, a] is the angle of the polar coordinate system. This equation 
defines the points in the accumulator space dependent on radius r,. All mov- 
ing cells can be identified using HT to process the moving image N(k) 
(Fig. 5). 


2.3 In vivo tracking microparticle 


To date, in vivo cells are identified with image processing techniques. How- 
ever, the video is discontinuous in time. We need to judge which of the 
identified cells is the target cell that we are tracking. In this chapter, posi- 
tional correlation method is used to track in vivo cells. 

In our experiments, the blood flow velocity was less than 6 x 107° m/s, 
and the capture rate was set to 20 Hz. The cell movement distance between 
the two adjacent frames was less than 3 pm, which is slightly smaller than the 
radius of the tracked cells (~4-5ym). Therefore, the cell can be easily 
tracked by finding the closest cell in the next frame. As the velocity of blood 
flow increases, the method can still be used by increasing the capture rate. 





Fig. 5 Moving cell detection. 
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Fig. 6 Flowchart of the cell detection scheme. 


Update the measured 








Fig. 6 illustrates a flowchart of detection of moving cells. The measured 
ae : ~ 2 : é 
cell position is denoted as p, € R°*'. Given the measurement noise during 


imaging, p, includes the true value and error and expressed as 


~ 


P.=p,to, (16) 


where p,€ R**' is the actual position of the cell, and @€R**' is the 
measurement error. 





3 Transportation of microparticles in vivo 


Cell position information can be obtained in real time by using the 
image processing technique introduced in Section 2. The closed-loop 
OTs system for in vivo cell transportation can also be established. The 
essence of cell transportation is position control; the system will automati- 
cally move the cells from the initial point to a given destination. In contrast 
to in vitro transport, in vivo transport is not only affected by the disturbance 
of blood flow but also showed a possibility of collision between the target 
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cell and the other flowing cells. To achieve high success rate, in vivo cell trans- 
port requires a transport strategy. In this section, automatic in vivo cell trans- 
port is studied. Two kinds of controller are designed for in vivo cell transport 
with the OTs system. The performance of the controllers is analyzed and 
compared by simulation and experiment. 


3.1 In vivo cell transport with P-type controller 


As introduced in Section 1.2, the trapping force increases as the offset 
increases, in an approximately linear relationship, until the offset is larger 
than 7, and then decreases to zero as the offset increases. Therefore, the 
manipulation is efficient when the offset is less than r. A nonlinear saturation 
function is defined as follows: 


|x| +o = |Ilxl]| -o| 
x; 
2|I>|| 





Jo(*) = (17) 


where x € R?*" is the argument of the function f,(x), and o is a positive 
number representing the upper bound of the function. The radius would 
be different for different cell types, and so is r. In this chapter, we assume: 


Ka) = 0.7r, (18) 


With this saturation function, the optical trap position will be limited in an 
efficient area. Then, a saturation P-type controller can be designed as follows 
(Li et al., 2015a): 


UOT =P, + fry (Rp e) (19) 
e=p; —p,=e-a, (20) 
where u97€ R?*' denotes the coordinate of the optical trap, pa€ R?*! 


denotes the coordinate of the destination, e=p,—p, denotes the error 


between the desired and actual positions of the cell, @ denotes the estimate 
of the error e, and k, is a positive real number as gain factor. 

In low Reynolds number environment, the inertia force of cells can be 
ignorable (Arai et al., 2004; Wu et al., 2011). According to v,=p,, the rel- 
ative speed of the trapped cell with the blood flow can be defined as follows: 


v=p.-» (21) 
and Eq. (7) can be rewritten as: 


F, — 62zpRv=0 (22) 
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The offset of optical trap can be calculated as: 


d,=uor— Pp, (23) 
According to Eq. (8), the trapping force can be described as: 
F,=kor(or — p,) (24) 
when 
\|tor — pl] <1 (25) 


Assuming the measurement error @ =0 and substituting Eq. (19) into 
Eq. (24), we obtain 


F,=korfiy (kpe) (26) 


Because of the nonlinear saturation function (17), format (25) always holds. 
Substituting Eqs. (21), (26) into Eq. (22), we obtain the following closed- 
loop dynamics equation: 


: kor 
cae OS 27 
co Yl éxpi'" (kpe) ( ) 


When p,=0, the system reaches stable state. Substituting p.=0 into 


Eq. (27), we obtain 


kor 
=f 28 
a énui™ (kp é) ie) 


To ensure the equation has a solution, the necessary and sufficient 
condition is 


korto 
6mpr 





lll] < (29) 
When Eq. (29) is satisfied, the following equation can be obtained from 
Eq. (28): 


6mpr 


——-p 30 
kpkor ee) 


Po Pa + 
If the blood flow velocity v; is constant, (30) will have a unique solution. 
Apparently, the position control system has steady-state error 62p1rv//k,kor- 
According to Eq. (29), the length of the steady-state error is less than ro. The 
integral term, which is used to eliminate the steady-state error, will cause 


Automated transportation of microparticles in vivo 297 





overshoot and have a great impact on system real-time performance. In con- 
trast, a steady-state error is acceptable. 


3.2 In vivo cell transport with the disturbance compensation 
controller 

As the analysis in Section 3.1, the P-type controller fails to overcome the 
influence of the drag force caused by blood flow, which results in a variation 
of the cell transportation trajectory and relatively large steady-state error. To 
eliminate this effect, a disturbance compensation controller is proposed 
(Li et al., 2016), as shown in Fig. 7. The proposed control system is divided 
into the disturbance observer and controller. The disturbance observer aims 
to observe and measure the disturbance caused by the drag force of the 
blood flow. The controller calculates the optical trap position based on 
the cell position, destination, and estimated disturbance, with minimized 
steady-state error. Furthermore, the cell transportation trajectory can be 
updated online by adjusting the parameters of the observer. The change 
of trajectory caused by collisions with other obstacles can be corrected 
simultaneously. 

According to Eqs. (21), (22), and (24), the following equation can be 
obtained: 


P.=——d4, +» (31) 
er 
Definition 10.1 The disturbance is defined as an equivalent offset of the 


optical trap caused by the blood flow, which can be expressed as € = fv, 
where p= 6aptt/kor. 
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Fig. 7 Disturbance compensation control system. 
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With Definition 10.1, Eq. (31) can be rewritten as follows: 


1 
P. = (4, +e) (32) 
p 
Disturbance € is determined by designing a disturbance observer, as follows: 
x=Ax+ Bu 
€ = Cx+ Dw’ ve) 
where 
A=—al 
B=(|(a—a’f)\I —al| 
C=I 4) 
D=|[afI 0| 
u= P. | (35) 
“oT 
Wor =p,+4d, (36) 


Note that x in Eq. (33) represents the observer status, and € is the observer 
output that represents the estimate of the disturbance €. @ is a positive 
real number. 

The observer status can be initialized at the beginning of manipulation, as 
follows: 


x=€—app., (37) 


where €o is the initial value of the estimated disturbance and is usually given 
as follows: 


Eo = bp, (38) 


where b is a positive real number. Parameter 6 affects the initial value of the 
observer, and further, the initial direction of the trajectory. In the current 
study, parameter b can be in the range of [1,5]. 

The disturbance compensation controller is then designed based on 
Eq. (17). The position of the optical trap can be given as follows: 


UOT =p. + fry (fn (e) _ é) (39) 
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3.3 The enhanced disturbance compensation controller 


In order to improve the steady-state performance of the controller and the 
performance in high-speed blood flow, an enhanced disturbance compen- 
sation controller is designed (Li et al., 2017). Fig. 8 shows its structure. 

To reduce the influence of the measurement error @ on the observer 
while ensuring the convergence speed of the observer, an observer with var- 
iable parameter is proposed. The structure of the observer remains 
unchanged, and the parameter a is changed to variable parameter, expressed 
as follows: 








a= ape tll + do— Bp. (40) 
@ is a variable parameter, which decreases as the disturbance estimate € 
approaches the true value €. @ and y are positive real numbers. In addition, 
the selection of parameters @ and y affects the observer performance and the 
cell transportation trajectory. The larger the parameter Qo, the faster the con- 
vergence rate of the observer. A large parameter y will help in reducing the 
steady-state error of the observer. 

Based on Eq. (17), the enhanced disturbance compensation controller is 
designed as follows: 


UOT =p. a (fh (e) — for, (€)) ’ (41) 


where g>1 is a positive real number. 


3.4 Experiments 


Simulations of moving single target cells in the blood vessel were performed first. 
The environmental parameters used in the simulations are as follows: trapping 
stiffness, k= 1.5 x 107° N/m; dynamic viscosity, u=4 x 107° Pa s; cell radius, 
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Fig. 8 Diagram of the enhanced disturbance compensation controller. 
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r=1x10 > m; and sampling time, T= 0.05 s. Based on Belharet et al. (2012), 
the speed of blood flow in the blood vessel is in parabolic distribution. In the 
simulation, the direction of blood flow is along the x-axis, and the velocity 
of blood flow has a parabolic distribution along the y-axis. 

The countercurrent of the target cell with respect to the blood flow 
direction in in vivo environment makes the cell easily crash with other cells 
because of the high density of cells in the environment. The cell is not easy to 
move backward using optical tweezers if the maximum trapping force is less 
than 6zprv;. Thus, the reverse movement of the cell should be avoided. 
Considering that blood flow runs faster in the middle than in the other parts 
of the vessel (Belharet et al., 2012), a stream of cells may be formed; and 
when a cell moves in the stream, it has a higher chance of colliding with 
other cells. Therefore, at the beginning of the transportation, the cell should 
be controlled to move perpendicular to the flow direction to escape from the 
cell stream, and then move along with the flow direction. In this way, the 
probability of collision can be significantly reduced. 

The proposed controller allows the trajectory to be adjusted online with 
the disturbance observer. The disturbance may not be compensated per- 
fectly when the disturbance observer estimates the disturbance, and this 
characteristic affects the trajectory generation. Three parameters ao, ), 
and @ in the observer will play important roles in adjusting the trajectory. 
Parameter b is used to adjust the initial value of the disturbance observer, 
which affects the initial direction of the movement trajectory in getting away 
from the cell stream. Fig. 9A illustrates the cell transportation trajectories 
with different values of b when a) = 2, p=2, andy= 10°, where the veloc- 
ity of blood flow is in parabolic distribution. An increase in b causes a large 
deviation of the cell movement trajectory from the blood flow. Parameter a 
is used to adjust the tracking speed of the observer and the noise rejection 
capability. This parameter is also used to adjust the curvature of the trajec- 
tory. Fig. 9B shows the transportation trajectories with different values of ao 
when b=2, p=2, andy=10 °. All the trajectories with different values of 
a have the same initial directions when b is fixed. As @ increases, the curva- 
ture of the trajectory becomes smaller and the cell moves more directly 
toward the desired position. 

Based on (Li et al., 2015a), the stability of the system cannot be definitely 
guaranteed unless the condition that ||e|| <1o always holds. Given that the 
drag force of blood flow is large and may not be compensated by the optical 
trapping force, the condition ||e|| <r can only hold when the cell moves 
near the vessel wall. Fig. 9C illustrates the transportation trajectories with 
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Fig. 9 The simulation result of cell transportation trajectories. (A) Cell transportation trajectories with different values of 6. (B) Cell transpor- 
tation trajectories with different values of a. (C) Cell transportation trajectories in rapid blood flow environment with different values of ¢. 
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different yg, where ||€|| <1 holds around the destination but not at the initial 
position. The other parameters are @=5, b=5, and y=10 ©. Clearly, the 
proposed controller with all of the different parameters can drive the cell 
toward the destination, and when g= 2, the cell can achieve ||€|| <1 more 
quickly. With the P-type control, however, the cell fails to reach the des- 
tination, because the P-type controller cannot help the cell to move away 
from the cell stream. 

Collision with other cells and obstacles is inevitable during transport of 
the target cells in vivo. Furthermore, the controller should also be able to 
drive the cell back to the original trajectory after collisions. The influence 
of collision on cells is treated as disturbance and handled by the disturbance 
observer. The controller can compensate this disturbance to maintain the 
cell in its original trajectory. Fig. 9D shows the transportation trajectory 
when the collision exists with different values of aj), where b=2, p=2, 
and y=10 °. The collision is simulated by adding an offset of 10~° m in 
the x-axis direction on the target cell position. Evidently, the proposed con- 
troller can effectively compensate for the influence of the collision and drives 
the cell back to the original trajectory after collisions. However, the P-type 
controller (Li et al., 2015a) does not have such capability. 

Steady-state error is an important criterion used to evaluate the 
performance ofa position controller. The steady-state error of in vivo trans- 
portation is mainly due to the drag force caused by the blood flow (Li et al., 
2015a). The proposed disturbance compensation controller can observe 
and compensate the drag force such that the steady-state error and the over- 
shoot can be minimized. Fig. 10 illustrates the disturbance observer errors 
and the position errors, under the controller with the variable 
parameter observer, the controller with the fixed parameter observer, and 
the P-type controller. The measurement error is set as a white noise with 
a magnetite of 1j1m. The steady-state error under the proposed variable 
parameter observer is ~0.1 1m, which is less than that under the fixed 
parameter observer. 

Experiments were then performed to track RBCs in 30-hpf zebrafish to 
demonstrate the effectiveness of the proposed controller. The RBCs of 
zebrafish before 48 hpf have a regular spherical shape, and can be easily iden- 
tified and controlled. Fig. 11 shows the sinus venosus of zebrafish (with a 
depth ranging from 10 to 60pm) where the cell movement experiment 
was performed. Given that zebrafish is transparent, the depth limit of the 
optical tweezers can reach ~120pm, which is larger than that for mouse 
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Fig. 10 Observer errors and position errors under the controller with the variable 
parameter observer, the controller with the fixed parameter observer, and the P-type 
controller. (A) Observer errors. (B) Position errors. 


(~60y"m) (Zhong et al., 2013b). Therefore, the cell transportation in 
zebrafish is immune to the depth limit of optical tweezers. The experimental 
process is described as follows: first, the program searches for the cell around 
the initial position; then, the identified cell is driven to the destination by the 
proposed controller and reaches a steady state; finally, the system goes back 
to the initial position for another trial. Each transportation trial was repeated 
for more than 30 times. The laser output power in all of the experiments was 
set to 3 W (~450 mW in the sample), which could provide an optical trap- 
ping force of 20pN without causing significant heat damage to cells 
(Johansen et al., 2016; Gou et al., 2014). Two controllers, namely, the 
enhanced disturbance compensation controller and the P-type controller 
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Fig. 11 Venue of the cell movement experiment in the yolk of zebrafish. 


(Li et al., 2015a), were implemented in the experiments for comparison. 
Two groups of experimental results are reported. 

The environmental parameters in the first group of experimental 
results were set as follows: flow velocity at the initial position, 
D, = (—0.9254, —0.9623) x 107-° m/s; estimate of the parameter, 


p= 0.125s. The initial position of the trapped cell was (0.7026,0.4186) x 
10-* m, the coordinate of destination was (0.2730,0.3256) x 10-* m, and 
the measure error was 1—2 tm. The parameters of the proposed controller 
were b=2, ay=0.5, p=2, and y=3 x 10~’, and the parameter for the P- 
type controller was k,, = 1. The cell transportation was repeated for 10 times. 








Table 2 shows the average steady-state error and the travel time of each trial. 
The average steady-state error was calculated by [|le||dt/{»1dt, where t rep- 
resents the time and X= {1| |le|| <1 x 10°}. With the proposed controller, 
nine cells successfully arrived in the destination, and one cell failed. With the 
P-type controller, only six cells arrived in the destination, and four cells 
failed. This result confirms that the proposed controller can achieve a high 
success rate in the transportation. Fig. 12 illustrates the position errors under 
the proposed controller and the P-type control of one trial, for comparison. 
The travel time under the proposed controller is 3.31s, which is less than 
4.78s under the P-type controller. The average steady-state error under 
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Table 2 Average steady-state error and travel time. 
Disturbance compensation 








controller P-type controller 

Experimental Average steady-state Travel Average steady-state Travel 
trial error (um) time (s) —_ error (jum) time (s) 
1 2.53 5.80 2.90 4.78 
2, Fail Fail 3.94 4.14 
i) 1.91 4.30 Fail Fail 

4+ 3.45 3.72 3.14 4.60 
5 2.47 6.34 2.41 4.46 
6 3.38 5.73 2.14 7.88 
7 2.41 6.08 Fail Fail 

8 2.27 3.47 Fail Fail 

9 1.64 4.77 Fail Fail 
10 1.93 3.31 2.89 6.56 
Mean 2.44 4.84 2.90 5.40 





the proposed controller is 1.93 um, which is less than 2.90 1m under the 
P-type controller. Fig. 13 shows the cell transportation trajectories with 
10 experimental trials under the proposed disturbance compensation con- 
troller and the P-type controller (Li et al., 2015a), respectively. Evidently, 
the trajectory generated by the proposed controller was initially perpendic- 
ular to the flow direction and then turned toward to the destination. This 
phenomenon indicates that the proposed controller can make the cell move 
away from the cell stream at the beginning and then successfully drive the cell 
to the destination. 

The environmental parameters in the second group of experiment 


are as follows: flow velocity at the initial position, ¥;=(—0.1389, 


—0.0851) x 10~* m/s; the estimate of the parameter, p= 0.125; initial 
position coordinate of the trapped cell, (0.6450,0.2105) x 10° * m; the posi- 
tion of destination, (0.1334,0.3905) x 10 * m. The proposed controller 
employed parameters of p=2 and y=3 x 10°’. Fig. 14 shows the experi- 
mental process of cell transportation with collision. The proposed controller, 
with parameters of b=2.5 and a@y=0.2, could manipulate the cell back to 
the original trajectory after colliding with other cells. Fig. 15 illustrates 
the cell transportation process under the proposed controller with three 
groups of parameters, namely, b=1.5 and aj=0.2, b=1.5 and ay=1, 
b=0.5, and ay=0.2, and the P-type controller (k, = 1). An increased value 
of b made the initial direction of the cell movement deviate more remarkably 
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Fig. 12 Position errors in cell transportation experiments. (A) Position error in x-axis. (B) 
Position error in y-axis. (C) The norm of the position error. 


from the flow direction, which can be seen through comparison of the initial 
trap force direction in Fig. 15C (b=0.5) and that in Fig. 15A and B 
(b =1.5). Furthermore, an increased value of @ minimized the curvature 
of the trajectory. The steady-state errors of the proposed controller with 
the three groups of parameters are similar, which are all considerably lower 
than that under the P-type controller. 
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Fig. 13 Cell transportation trajectory. 





4 Collision avoidance in vivo 


To date, automatic in vivo cell transport has been achieved, and the 
effects of disturbances caused by blood flow have been minimized using dis- 
turbance compensation controller. However, a large number of RBCs exist 
in blood vessels. Collisions between the target cell and the other flowing 
cells are prone to occur during transport, resulting in transport failure. In this 
chapter, a collision-avoidance vector method is developed to solve the 
collision-avoidance problem in vivo (Li et al., 2018). Based on the method, 
the in vivo cell transport system exhibits collision-avoidance capability. 


4.1 Collision-avoidance vector methods 


The proposed collision-avoidance strategy aims to ensure that the trapped 
cell maintains a safe distance from other particles during its transportation 
to its destination. In previous studies, the position of the obstacle must be 
first identified using image processing. However, the identification of all 
the positions of obstacles is very time consuming and difficult, especially 
for chaotic in vivo images. A large amount of computational work will also 
affect the control performance of the system. Poor identification accuracy 
will cause the collision avoidance to fail, in turn causing the cell transporta- 
tion task to fail. 

To solve this problem, a novel concept, named the collision-avoidance 
vector, is proposed in this paper. 
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Fig. 14 Cell transportation with collision under (A) disturbance compensation controller with b=2.5 and a9=0.2. (B) P-type controller. 
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Definition 10.2 (Collision-avoidance vector) 
The collision-avoidance vector is expressed as G=[G,, G,] T with the com- 
ponents calculated as follows: 


Ry Ry 


Ge= So SS Se(Ax, Ay) tty, + ax py +ay(h), (42) 
Ax=—R, Ay=—R, 


Ry Ry 
Gy = Se S- 6y(Ax, Ay) tp. + Ax,py + dy(k), (43) 


Ax=—R, Ay=—R, 


where R, denotes the maximum detection radius; Ax=x—p,. and 
Ay=y-— Pp. are the distances between the current position and the detected 
position p, in the X and Y coordinate directions, respectively; and 6(Ax, 
Ay) =[6,(Ax, Ay), 6,(Ax, Ay)|" denotes the collision-avoidance operator, 
which includes components in the X and Y directions. 

Fig. 16 illustrates the process of calculating a collision-avoidance vector. 
The size of the collision-avoidance operator depends on image resolution 
and the radius of the obstacle detection region. Fig. 16 shows that the image 
of an obstacle is composed of a plurality of pixels with ny +a.x,pcy+ay(k) 0. 
Therefore, avoiding collision from an obstacle is equivalent to avoiding 
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Fig. 16 Calculation of the collision-avoidance vector. 
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collision from those pixels in relation to the obstacle. The collision- 
avoidance operator 6(Ax, Ay) is used to guide the cell to avoid a single pixel 
at (Ax, Ay). Taking the intensity value of the pixel as the weight, the colli- 
sion vector can be calculated by summing all the vectors in the collision- 
avoidance operator by weight. With a different collision-avoidance operator 
6(Ax, Ay), the proposed controller can employ different strategies without 
changing the control structure. Two operators for collision avoidance will 
be discussed here. 


4.2 Collision-avoidance controller 


Utilizing the collision-avoidance vector, a collision-avoidance controller is 
designed to transport the trapped cell to its destination while avoiding obsta- 
cles and compensating for the disturbance caused by blood flow. Fig. 17 
shows the schematic of the proposed cell transportation control system with 
collision-avoidance capability. 

The disturbance compensation controller was proposed to eliminate the 
effect of the drag force caused by blood flow. The disturbance observer can 
be used to adjust the moving direction of the target cell in the motion con- 
trol. With this feature, a new disturbance compensation controller is 
designed in this section, aiming to avoid collision while eliminating the 
effect of drag force. Utilizing the collision-avoidance vector, the estimate 
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Fig. 17 Schematic of the cell transportation control system. 
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of disturbance, and the nonlinear saturation function, a controller that cal- 
culates the position of the generated optical trap is designed as follows: 


UOT =P, + fry (fo (e) — é + 7G) ’ (44) 


where y denotes the weight of the collision-avoidance vector. Because the 
new controller is based on the disturbance compensation, the effect of the 
measure error @ is also similar and was discussed in Section 3. In this section, 
the measure error can be ignored, and we have p,=p, and e =e. 

With the proposed controller (44), the positions of the other particles 
need not be identified, which significantly reduces the amount of online 
computational work. 


4.3 Collision-avoidance operators 


First, a so-called cotton operator is proposed by treating the trapped cell as if 
it is covered with a layer of invisible cotton to make the cell bounce off from 
obstacles. 


Definition 10.3 (Cotton operator) 
The cotton operator is defined as: 








—Ax _ Ve Ro)" 

CY an er ke ae (45) 
0, else 
—Ay (Ry 

je Aa, © a Bese RL (46) 
0, else 


where R> denotes the minimum detection radius; r= ./Ax? + Ay? is the 
distance between the current pixel (x,y) and the detected position p, of 
the cell; and cE R denotes the standard deviation. 

Fig. 18A and B show the 6,(Ax, Ay) and the 6,(Ax, Ay) of the cotton 
operator, respectively. Fig. 18C illustrates the vector field of the cotton 
operator. Every pixel around the detected cell corresponds to a vector that 
is calculated by the collision-avoidance operator. The pixel with a smaller r 
corresponds to a longer vector length. However, when the pixel is 
extremely close to the trapped cell (r< Ro), it may be a part of the target cell 
image and should be ignored; in this regard, the corresponding vector length 
is zero. The pixel corresponds to a vector direction from the pixel position to 
the target cell position. Along this direction, the target cell will move away 
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Fig. 18 Cotton operator. (A) The x-axis component of the cotton operator 6,(Ax, Ay). 
(B) The y-axis component of the cotton operator 6,(Ax, Ay). (C) The vector field distribu- 
tion of the cotton operator. 


from the corresponding pixel position. By considering all the pixels around 
the trapped cell, the collision-avoidance vector G can be obtained as the 
weighted sum of all the corresponding vectors with weights that are the 
intensity value Mp +Ax,pcy+Ay(k) of pixels. Moving along the direction of 
the vector G will ensure that the cell avoids collision with other particles. 
Given that the cotton operator can be calculated offline, the online compu- 
tational load for obtaining the vector is only O(R2”), which is considerably 
lower than those of traditional obstacle detection algorithms. 

The cotton operator utilizes a simple method to drive the trapped cell 
away from the other particles. With this strategy, the controller successfully 
avoids moving obstacles. However, when a stable obstacle exists in the envi- 
ronment and blocks the forward path of the controlled cells, the cotton 
operator has to drive the cells backward, which may not be the best method. 
Therefore, the cotton operator is more suitable for avoiding a moving obsta- 
cle but not for avoiding stable obstacles. 

The effect of obstacle avoidance varies when different operators are used 
in the controller. Consider an obstacle with a neighborhood of pixels, with 
element number m€N (m«C) and its velocity relative to blood flow is 
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expressed as v, € R°*'. The distance between the trapped cell and the obsta- 
cle is expressed as 1. 

Second, another collision-avoidance strategy that allows the trapped cell 
to bypass an obstacle in its forward path is proposed here. Given that this 
strategy makes the cell behave like a bar of soap that slips away from the 
obstacle, we designated this collision-avoidance operator as the soap 
operator: 


Definition 10.4 (Soap operator) 
The soap operator is defined as: 


y x 


where j= [j,.,jy] Tis a unit vector along the forward moving direction of the 
controlled cell and 6,(Ax, Ay) = [6;,(Ax, Ay), 6j,(Ax, Ay)] T has the following 


expressions of the components: 





_ (r= Ro)” 
u(x, Ay) = 4 —(cos8— 0.5)" 2, Ro<r<Ri, (48) 
0, else 
—O(cos@ + 1) (Ry) 
6iy(Ax, Ay) = 2|0| ’ ae Se , (49) 
, else 


where 6 € (— 2, 2] denotes the angle between vector j and vector [Ax, Ay]. 

Unlike the cotton operator, the soap operator is not isotropic, and its uti- 
lization of cell motion in the forward direction makes the operator more 
purposeful. When an obstacle blocks the trapped cell from moving forward, 
the cell slightly changes its direction to continue its movement. Fig. 19A and 
B shows the components of the soap operator 6,(Ax, Ay), which shares sim- 
ilar properties with the cotton operator. The pixel with a smaller r exerts a 
large influence when r> Ro, and has no influence when r< R9. The direc- 
tion of the soap operator, as shown in Fig. 19C, is different from that of the 
cotton operator. Therefore, the controller with the soap operator employs a 
collision-avoidance strategy that is different from that employed by the cot- 
ton operator. Although the computational load with the soap operator 1s 
more than that of the cotton operator because of the required extra coordi- 
nate transformation with Eq. (47), it is still within O(R27). 

Note that the unit vector of the cell forward direction j, which is defined 
in Definition 10.4, determines the direction of the soap operator when the 
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Fig. 19 Soap operator. (A) The component of the soap operator 65;,(Ax, Ay) in the j direc- 
tion. (B) The component of the soap operator 6,,(Ax, Ay) in the [—jy, jd’ direction. (©) The 
vector field distribution of the soap operator. 


collision-avoidance vector is calculated. This vector further affects the per- 
formance of controller in avoiding obstacles. In this study, two different for- 


ward directions are considered: the target direction (f,,(e)— €) / Ilf (e) —€ | 


and the instantaneous direction (f,,(e)—€ + G) /||f,(e)—€ + G||. The 
target direction is fixed when the cell position error e and the estimate of 
the disturbance € are fixed. With the target direction, the moving direction 
of the trapped cell changes slightly when the cell encounters an obstacle, 
which helps the cell to keep moving forward to the destination in a highly 
cell-dense environment. With instantaneous direction, the collision- 
avoidance vector changes even when the position error e and the estimate 
é are fixed, which enables the trapped cell to continuously search the sur- 
rounding environment and escape from the local minimum. 

Finally, the difference between the cotton operator and the soap operator 
is discussed. Although theoretically the controller with the cotton operator 
exhibits better obstacle avoidance performance than that with the soap oper- 
ator, the controller with the soap operator behaves in a more intelligent 
manner in an obstacle-dense environment. Fig. 20 shows the difference 
between the cotton operator and the soap operator when the trapped cell 
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Fig. 20 Operators in handling two obstacles. (A) The collision-avoidance vector of the 
cotton operator pushes the cell to move away from the two obstacles to avoid a colli- 
sion. (B) The collision-avoidance vector of the soap operator guides the cells to pass 
through between the two obstacles. 


encounters two obstacles. Based on Eq. (44), the cell actually moves in the 
direction along the sum of vectors f,(e)—€ and yG. In Fig. 20A, the 
collision-avoidance vector of the cotton operator pushes the cell to move 
away from the two obstacles to avoid collision. In Fig. 20B, the collision- 
avoidance vector of the soap operator guides the cells to pass through 
between the two obstacles. 


4.4 Experiments 


For simulations, the target cells were transferred to a destination in a working 
environment with stable and moving obstacles. The simulation scenario was 
extracted from the actual in vivo environment of living zebrafish. Both the 
cotton operator and the soap operator with two different forward directions 
(namely, target direction and instantaneous direction) were employed in the 
simulations. The environmental parameters were selected as follows: trapping 
stiffness, k= 1 x 107° N/m; dynamic viscosity, 4=6 X 107° Pas; cell radius, 
r-=3™xX 10° m; maximum detection radius, R,=100 pixel; minimum detec- 
tion radius, R2=35 pixel; image resolution, 1 pixel=1.224 x 10-’ m; 
weight of the collision-avoidance vector, y=0.15; and sampling time, 
T=0.05 s. 

Figs. 21 and 22 show the simulation results for avoiding two different 
stable obstacles. In the simulations, the blood flow speed v; was set to 0 to 
simulate the in vitro environment, and the standard deviation was c= 15. 
Fig. 21 shows that the trapped cell could avoid obstacles and finally arrive 
at the destination under the proposed controller with all the operators. 





Fig. 21 Simulated trajectories with sparse stable obstacles. (A) Beginning scenario. 
(B) Cell movement trajectory under the cotton operator. (C) Cell movement trajectory 
under the target direction soap operator. (D) Cell movement trajectory under the instan- 
taneous direction soap operator. 
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Fig. 22 Simulated trajectories with crowded stable obstacles. (A) Beginning scenario. 
(B) Cell movement trajectory under the cotton operator. (C) Cell movement trajectory 
under the target direction soap operator. (D) Cell movement trajectory under the instan- 
taneous direction soap operator. 
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The cell movement trajectories with the target-direction soap operator 
(Fig. 21C) and the instantaneous-direction soap operator (Fig. 21D) were 
smoother, whereas the trajectory with the cotton operator (Fig. 21B) oscil- 
lated slightly when an obstacle was encountered. In Fig. 22A, the trapped 
cell is surrounded by obstacles at the beginning of the scenario. Only the 
use of the soap operator with instantaneous direction, as shown in 
Fig. 22D, could drive the trapped cell to the destination. Using the cotton 
operator (Fig. 22B) and the target direction soap operator (Fig. 22C) resulted 
in the trapped cell being blocked by the local minimum, which caused the 
cell transportation task to fail. Under the instantaneous-direction soap oper- 
ator, as seen in Fig. 22D, the cell continued searching the surrounding envi- 
ronment and discarded the local minimum to move forward. 

Fig. 23 shows the simulation results for the avoidance of moving obstacles. 
In this simulation, the blood flow speed was set as v;= (0.17,0.1) x 10-4 m/s, 
which simulated the in vivo environment, and the standard deviation was 
c= 10. At the times of 1.60—2.10s, the trapped cell must move along the direc- 
tion of blood flow to avoid collision with obstacle A. The use of both the cot- 
ton operator and the soap operator enabled the trapped cell to avoid the 
obstacles effectively. The controller behaved differently with different opera- 
tors. Compared with the cotton operator (see Fig. 23A), the soap operator 
made the trapped cell move a longer distance to reach the destination and 
maintained a smaller distance to obstacle A at the time of 2.10s (see 
Fig. 23B and C). When the cell density was high and avoiding all collisions 
became difficult, the controller with the cotton operator prioritized collision 
avoidance and tended to ignore cell transport, whereas the controller with the 
soap operator struck a balance between collision avoidance and cell transport. 
When the cell density was sparse, the cotton operator was more advantageous 
because of its stronger capability to avoid obstacles. 

Experiments were further performed to transfer yeast cells in vitro and 
RBCs in 30-hour postfertilization (hpf) zebrafish in vivo. The environmental 
parameters used in experiments were set as follows: environmental parame- 
ter, B=0.125 s; image resolution, 1 pixel=1.224 x 10-7 m; maximum 
detection radius, R; =100 pixel; minimum detection radius, R2=50 pixel; 
weight of the collision-avoidance vector, y=0.15; and standard deviation, 
c=15. The laser power in all experiments was set to 3W (~450mW in 
the sample), which provided an optical trapping force of 20 pN on cells with- 
out causing significant heat damage to cells (Clevers, 2011). 

Fig. 24 shows the in vitro experimental results with the proposed con- 
troller. In this experiment, a yeast cell was controlled and the flow speed », 
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Fig. 23 Simulated trajectories with moving obstacles. (A) Cell movement trajectory under the cotton operator. (B) Cell movement trajectory 
under the target-direction soap operator. (C) Cell movement trajectory under the instantaneous-direction soap operator. 





OAIA Ul Saj>YedOI!W JO UOeVOdsue pajewoiny 


6LE 


&® ot, © © 
iD= | ) 
f. b a) @ 
) 
° +e) |. ts) sth; 3 
} @ ea k “> 4 23) the. 





re) 
@ 9 : ¢ 
oe - eDa < i eOa sito S35 
aN 3) - ® @ Cy“ Cy 
*, : 
Xe 8 Q e Oo a © 


Fig. 24 Experimental results in vitro. (A) Cell movement trajectory with the cotton operator. (B) Cell movement trajectory with the target 
direction soap operator. (C) Cell movement trajectory with the instantaneous direction soap operator. 
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was zero. The yeast cell moved from the starting position to the destination, 
and then moved back to the starting position. Two different tracking tasks 
were implemented under the controllers with the cotton operator, the soap 
operator with target direction, and the soap operator with instantaneous 
direction. Fig. 24A-1, B-1, and C-1 shows the different performances of 
the operators in task 1, where the trapped cell was stuck at the local mini- 
mum (points A, B, and C). The trapped cell was stuck for 7 s at point A 
(Fig. 24A-1) and for 6s at point B (Fig. 24B-1). This phenomenon occurred 
because the controllers with the cotton operator and the soap operator with 
the target direction could not escape from the local minimum. By contrast, 
the soap operator with the instantaneous direction could have the trapped 
cell search and escape from the local minimum; thus, the cell immediately 
left point C (Fig. 24C-1). Fig. 24A-2, B-2, and C-2 shows the different per- 
formance of the operators in task 2, where the trapped cell was required to 
pass between obstacles. As shown in Fig. 24B-2 and C-2, the soap operator 
guided the cell to pass between obstacles. By contrast, the cotton operator 
drove the trapped cell away as seen in Fig. 24A-2. Fig. 25 shows the position 
errors between the cell and the destination in these two tasks. 

Figs. 26 and 27 present the results ofan in vivo experiment performed on 
a living, 30-hpf zebrafish. The experiment was performed in the sinus 
venosus of the zebrafish, where the flow speed was v;=(—0.252, 0.09) x 
10-* m/s. In this experiment, an RBC was controlled to move toward a 
destination. Fig. 26A—C shows the cell movement trajectories under the 
controller with the cotton operator, the soap operator with target direction, 
and the soap operator with instantaneous direction, respectively. Fig. 26 
shows the corresponding position error |le|]. All three operators helped 
the controller drive the trapped cell away from the other particles during 
transportation and arrive at its destination. As shown in Fig. 26A, the cotton 
operator maintained a larger distance between the target cell and the obsta- 
cles than the soap operator. This phenomenon indicated that the cotton 
operator emphasizes collision avoidance and optimizes the performance 
of the controller with the cotton operator when cell density is low. By con- 
trast, the soap operator performs better when the cell density is high because 
it strikes a balance between collision avoidance and cell transport. As shown 
in Fig. 26B, the trajectory of the soap operator with target direction is the 
one with the smallest changes in its moving direction. This phenomenon 
makes the controller with the target direction soap operator more suitable 
for the rapid blood flow environment where the trap force is not very strong 
compared with the drag force. Under the soap operator with instantaneous 
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Fig. 25 Position errors of in vitro cell transportation experiment. (A) The cotton oper- 
ation. (B) The target direction soap operator. (C) The instantaneous direction soap 
operator. 


direction, the target cell had the most flexible movement, as seen in 
Fig. 26C. Therefore, the soap operator with instantaneous direction is more 
suitable for the slow blood flow environment where the trap force is suffi- 
ciently strong. Furthermore, the soap operator is able to handle the local 
minimum, which may appear in a slow (or static) blood flow environment. 





5 Conclusion and future work 


In vivo cell transport is a new research area vital for in vivo biological 
research and several potential applications, such as in determining the 
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Fig. 26 Experimental results in vivo. (A) Cell movement trajectory with the cotton operator. (B) Cell movement trajectory with the target 
direction soap operator. (C) Cell movement trajectory with the instantaneous direction soap operator. 
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Fig. 27 Position errors in the in vivo cell transportation experiment. 


mechanism of cancer metastasis, eliminating thrombus, targeted drug or cell 

delivery, screening nanoparticle-cell interactions for cancer therapy, and 

evaluation of tissue invasion in cancer and infection biology. This study ini- 
tially proposes a close-loop control system for in vivo cell transport based on 

OTs technology. With this system, a disturbance compensation controller is 

developed to overcome the influence of blood flow on the cell. A collision- 

avoidance vector method is proposed to handle the collision problem during 
in vivo transport. The main contributions of this chapter can be summarized 
as follows: 

(1) A close-loop control system is established to automatically transport cells 
in vivo by using a robot-aided OTs manipulation system. In this system, 
the cell position can be identified from the internal zebrafish images with 
image processing model and then tracked by position correlation 
method. A close-loop control system can be established based on the cell 
position by using a saturated P-type controller. Experiments are per- 
formed to demonstrate the effectiveness of the proposed system. The 
automatic in vivo cell transport was realized for the first time in this 
study, and the feasibility of the system was also demonstrated. 

(2) A disturbance compensation controller is developed to overcome the 
influence of fluids (e.g., blood flow) on the cell. The proposed controller 
treats the influence of blood flow as a disturbance, which can be 
observed and compensated. The controller allows the trajectory to be 
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adjusted online with the disturbance observer. When the trapped cell 
collides with other particles and deviates from its desired direction, 
the controller can enable the trapped cell to switch back to its original 
trajectory. Thus, the success rate of cell transportation is improved. 
The steady-state error of the cell motion can also be minimized by com- 
pensating for the disturbance caused by blood flow. Simulation and 
experimental results demonstrated that the proposed controller can effi- 
ciently and automatically transport a single trapped cell to the desired 
position. 

(3) An automated cell transportation controller with collision-avoidance 
capability is developed to handle the collision problem during cell trans- 
port. A collision-avoidance vector method is proposed to avoid obstacles 
during transportation of the target cell. The proposed method integrates 
obstacle detection and collision avoidance into a single step, thereby 
reducing the duration of online processing while enhancing the accuracy 
of obstacle detection. With the proposed approach, different collision 
avoidance strategies are designed to suit for different transportation envi- 
ronments. The proposed approach exhibits the advantages of reduced 
online calculation, fast response, high accuracy, and disturbance com- 
pensation. Simulations and experiments were performed to demonstrate 
the effectiveness of the proposed controller. 

This chapter may be used as basis for future studies. 

(1) In this study, an automatic cell transport system is developed. However, 
the system only can handle the cell transportation in a fixed visual field, 
which is too small to the entire body. This kind of cell transport can be 
only named as a local cell transport. To realize a global cell transport, the 
visual field should follow the target cell and the optical tweezer needs to 
manipulate the cell uninterruptedly. Future work will involve the devel- 
opment of a global automatic cell transport system. 

(2) With the proposed cell transport system, the target cell can be trapped 
and transported to the destination in zebrafish. This condition is suffi- 
cient for study of cancer metastasis. The cancer cell can be injected into 
zebrafish and transported to the target position with the transport system. 
In this technique, the location and initial cell number of the metastatic 
tumor can be precisely controlled. Therefore, future work will involve 
the study of cancer metastasis based on the proposed cell transport 
system. 

(3) Magnetic manipulation can direct the magnetic microrobot in deeper 
tissues. Compared with the OTs, the structure of an in vivo magnetic 
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manipulation system is similar and the dynamic equation of the control 
object is also the same. Therefore, several works in this chapter can be 
used in in vivo magnetic manipulation study. The proposed system can 
also be used as reference to build an in vivo magnetic manipulation sys- 
tem. Future work can focus on automatic in vivo microrobot manipu- 
lation with a magnetic manipulation system. 
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1 Introduction 


Nanoscience is the field of science concerned with the study of mate- 
rial with sizes ranging between 1 and 100 nm. The term nano comes from 
the Greek word for dwarf; so a nanometer is the length scale of 10” m. 
Nanotechnology can be defined as the study or the development of products 
done on the nanoscale using nanomaterials. Furthermore, describing any 
minor field of technology with nano refers to applying or developing this 
field at the nanoscale (Ramsden, 2018). The major scientific revolutions 
in the twentieth century made it possible to merge information technology 
and biotechnology with nanoscience and nanomaterials which made it pos- 
sible to other fields to emerge (Kumar and Kumar, 2014). 

Robots—or robota, or mechanical laborers—is an idea introduced by 
Karel Capek and Isaak Asimov in the theatrical play “Rossum’s Universal 
Robots” in 1920; this play paved the way for robots as an idea to emerge. 
Tracking the inspiration for robots would lead to the seventeenth century in 
Japan, during the Edo period, where the karakuri ningyo toys were consid- 
ered as robots for their mechanical properties and for their usage for tasks 
such as tea-serving (Hornyak, 2006). The characteristics needed nowadays 
to describe a device as a robot are the actuator, sensing element, controller, 
and frame. The actuator provides the robot with its degrees of freedom 
(DOF) while the sensing elements measure the properties of the surround- 
ings. Additionally, the controller makes an input-based decision to modify 
the actuator mode relying on the controlling operation. Finally, the frame 
houses the components for safety purposes (Tsitkov and Hess, 2017). 
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Assimilation of previously mentioned fields, robotics and nanotechnology, 
led to the synthesis of what is known as nanorobotics. Nanorobotics is an 
interdisciplinary compartment that supports applications in different fields 
such as biomedical engineering (Azar, 2011, 2012). 

The rise of nanorobots was on December 29, 1959, when Richard 
Feynman introduced the idea of single atom/molecule manipulation 
using nanotechnology in his talk “There’s Plenty of Room at the Bot- 
tom” (Kumar et al., 2014). Moving to 1974, Professor Norio Taniguchi 
illustrated nanotechnology and concepts of material deformation to 
output a separate cell (Kumar et al., 2014). Starting in the 1980s, Dr. Eric 
Drexler advertised nanoscale equipment in his published articles (Drexler, 
1989, 1992). In 1987, Dr. Eric Drexler published the first book on nano- 
technology that deals with the self-replication property of nanorobots 
(Drexler, 1987). 

Through the rise of nanorobots, it was necessary to note the comparison 
between nanorobots and micro-robots as it shapes a main concerning con- 
flict. Although both micro-robots and nanorobots are included in the class of 
small-scale devices, they have major differences that include scale, physics, 
and fabrication (Sitti, 2007). The primary difference is that components scale 
ranges from 1 to 100 pm (0.1 mm) for micro-robots while nanorobots com- 
ponents range from 1 to 100 nm (0.1 pm) (Ramsden, 2018). Regarding cur- 
rent achievements, micro-robots are taking advanced steps extended 
towards their manufacturing, but nanorobots are in the early stage of 
research and design. Besides, technologists rely on optical microscopes dur- 
ing working on micro-robots, which is not equipment compatible with 
nanorobots as they are too small to be seen. Therefore, electron microscopes 
have been used while developing nanorobots as they are dealing with an 
atom ora molecule at once. Additionally, different strategies are applied dur- 
ing fabrication of Nano and micro-robots; Bottom-up strategy is applied on 
the scale of nanorobots while micro-robots rely on top-down techniques of 
manufacturing (Ramsden, 2018). The collective field for micro-robots and 
nanorobots is the key applications in which both of them are anticipated to 
be utilized in healthcare, micro-, and nano-assembly (Bogue, 2010). 

There is no doubt that the complexity of system design is directly pro- 
portional to the requirements that the system must fulfil. From this concept, 
the nanorobotics field emerges to cross new boundaries in robotics and 
broaden the domain of its applications. The smaller the size of the robot, 
the higher its capability to be used in critical size-limiting environments, 
and the more crucial the functionality of the robotic system (Tsitkov and 
Hess, 2017). In addition, here lies the distinction and importance of 
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nanorobots from other known forms of industrial robots. The uniqueness of 
nanorobotics makes them the only solution for a set of challenging applica- 
tions, especially in medicine. According to Kumar et al. (2014), research is 
conducted to fabricate nanorobots that help performing surgeries in vivo 
using molecular nanotechnology (MNT), doing diagnosis, delivering treat- 
ment to patients of serious diseases such as AIDs and cancer, and manipu- 
lating genes by chromosomal genetic replacement therapy. Nanorobotics 
not only has contributions in medicine, but also has great applications in 
other fields such as in mechanical structure of small elements to be used 
in future nanomachines, such as Drexler’s bearing design (Drexler, 1992). 
Despite thorough interest being given to the research about nanorobotics, 
certain gaps have not been addressed well over the years. Obviously, previ- 
ous work in the field provides a solid ground for the evolution of nan- 
orobotics in different fields, but it lacks providing a complete conceptual 
design including all robot specifications and manufacturability. This insuffi- 
ciency of design components is the reason why manufacturing nanorobots 
still a challenge under the given technological capabilities. Accordingly, the 
main contribution of this chapter is to provide a sufficient review on com- 
ponents of nanorobots and how they can be integrated. In addition, appli- 
cable drivers are discussed, with the aim of clarifying several working 
principles covering their navigation and control, and applications of nan- 
orobotics in medicine is shown in brief in order to form a solid view about 
nanorobotics impact in such fields. 

The remainder of this chapter is organized as follows. Section 2 is the 
literature review presenting all previous work with their achievements, 
and their limitations. Sections 3 and 4 are proposing the framework of 
nanorobots. The third section includes full information about the possible 
elements such as sensors, actuators, and body parts followed by the fourth 
one that covers the current applicable designs. Then, Section 5 is dedicated 
to succeeding nanorobots with recent applications in the medical field. 
Section 6 is an exhaustive discussion that represents current limitations 
and future opportunities for research in this field. Then, conclusion about 
all main lines is conducted in Section 7. 





2 Related work 


Believing in the vision that one day nanorobots would be able to 
repair human tissues, Drexler (1992) proposed to freeze his body, cryogen- 
ically, upon death so that one-day human technology would be advanced 
enough in order to bring life back to his tissues using nanorobots 
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(Drexler, 1992). With advances in science and technology, the process of 
fabricating nanorobots follows one of two main strategies: bottom-up and 
top-down strategies. The former is based on construction of nanorobots 
from individual molecules and atoms while the latter is based on reducing 
the sizes of microscale objects by chemical or mechanical methods into 
nanoscale structures (Petrina, 2012). 

As far back as 2008, research was conducted to suggest and formulate a 
general algorithm or plan of how nanorobots can be manipulated within the 
human body, even in narrow blood vessels. A proposal for using flagellated 
magnetotactic bacteria in directing the nanorobot in vivo was presented by 
Martel et al. (2008). It uses computers to prove the idea that hybrid 
nanorobots—which are composed of both synthetic and biological compo- 
nents—can be controlled and tracked inside the body to deliver agents to 
tumor cells. In addition, another group of researchers applied an optimiza- 
tion method based on particle swarm optimization (PSO) algorithms in a 
simulation of multiple nanorobots investigating throughout the human 
body. The study aims to let the nanorobots organize and control motion 
on their own in order to have full monitoring over a coverage area (Hla 
et al., 2008). These robots can be used to discover the existence of a certain 
disease, rather than attacking a tumor cell or delivering a drug. Concluded 
from both researches, their approaches focus on propulsion, and algorithms 
to control movement and coordinate the robots rather than 
manufacturing them. 

In 2009, research focused again on the propulsion of nanorobots, and 
more specifically, on using flagella as a method for movement. A proposal 
for the use of helical flagella as a propulsion method for nanorobots is shown 
in Subramanian et al. (2009). In this contribution, mathematical modeling 
and MATLAB simulation was performed to verify the efficiency of this pro- 
pulsion method. Changes in the geometry of the helical pattern of flagella 
have shown that when the amplitude of the helical increases linearly, the 
model experiences faster propulsion and reduced internal strain at the flagella 
end than shown in a constant amplitude model. Additionally, a contribution 
by Wautelet (2009) described the construction problems of nanorobots 
starting from required precision to assemble such devices reaching the risk 
taken in approaching a full avoidance of surrounding disturbances that may 
cause malfunction. 

Proceeding to 2010, a study by Merina (2010) was done to discuss the 
potential of using nanorobots in heart transplant surgeries. The study covers 
medical knowledge about the surgery as well as suggested approaches to 
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fabricate nanorobots. This contribution could be considered a key for open- 
ing the door for further exploration in using nanorobots in medical appli- 
cations. At this point, it is obvious that researchers are going deep into 
exploration of what nanorobots can do, how to benefit from the emerging 
field, as well as how to use current technologies to apply nanorobots in 
reality. 

In 2011, a proposal by Martel (2011) was presented to discuss the use of 
flagellated bacteria as a propulsion for hybrid nanorobots until reaching the 
target area in the human body. This time, experimental results were pro- 
vided for using magnetotactic bacteria in blood and in water to control 
its directional motion and steering. Fig. 1 shows the microscopic observation 
of the movement of hybrid microrobot using flagella. Fortunately, the 
advances of research that is concerned with nanorobotics in 2011 expanded 
to include another important aspect. A contribution was made to suggest an 
algorithm by which nanorobots can reach their target using the nerve signals 
in vivo. Block diagrams for directional control (Fig. 2A) and speed control 
(Fig. 2B) are proposed to describe the process (Quader et al., 2011). 
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Fig. 1 Experimental results with optical microscope for a single flagellated inaijnetoiactic 
bacterium propulsion for hybrid microrobot. (From Martel, S.,, 2011. Flagellated bacterial 
nanorobots for medical interventions in the human body. In: Surgical Robotics. Springer, Bos- 
ton, MA, pp. 397-416, with permission.) 
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Fig. 2 Block diagrams for proposed directional control (A) and velocity control (B) for a 
nanorobot guided by nerve signals (Quader et al., 2011). 


In 2012, the goal of using nanomedicine as treatment for diabetes 
encouraged scientists to find an expected path that the nanoparticles 
(NPs) would take to deliver the insulin in vivo. However, they faced some 
obstacles due to the metabolic changes, intestinal barrier functions, and dif- 
ferences in blood flow that prevented them from proposing any initial design 
(Krol et al., 2012). Moreover, in the same year, a study proposed to show the 
potential of using nanorobots propelled by external electromagnetic field to 
detect tumors in the human breast. The nanorobot is tracked and monitored 
using differential microwave imaging (DMI), and single walled carbon nan- 
otubes (SWCNTS) are used in detection (Kosmas and Chen, 2012). It is 
exciting and interesting how research conducted in 2012 had encountered 
new areas for application of nanorobots in medicine such as diabetes and 
nervous system. There is no doubt that in 2013, researchers tackled the topic 
of nanorobots from different points of view. The revolution and develop- 
ment of nanomaterials had paved the way for Aguilar, in 2013, to propose 
theoretical considerations for using nanoparticles as targeted drug carriers 
and the factors affecting the process such as surface charge, particle size, 
and distribution (Aguilar, 2013). Additionally, the suggestion of nanorobots 
use in a new area of application was proposed. A simulation on nanorobots 
use for repairing injured blood vessels walls was done based on PSO algo- 
rithm and Herschel-Bulkley fluid model to represent the non-Newtonian 
blood (Trihirun et al., 2013). In this study, a rigid tube model for the blood 
vessel is used with the aim to use an elastic tube model in further research. 
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Furthermore, propulsion of nanorobots using flagella was, for the third 
time, a topic for study. In 2013, a proposal was made for the use of artificial 
flagellum in nanorobots to provide a propulsion mechanism for the robot 
inside the blood vessels. In other words, propulsion driven by external rota- 
tional magnetic field. Then, a motion MATLAB simulation is done on the 
proposed model where the flagellum is the tail of the robot (Xu, 2013). Also, 
a new approach of controlling the movement of nanorobots within the body 
is proposed to assist in performing surgery. This approach uses optical twee- 
zers and light pulses emission to guide the nanorobot towards its destination 
(Thammawongsa et al., 2013). In the same marvelous year of 2013, fabrica- 
tion of nanorobots came to reality using lasers. A fabrication process along 
with manipulation technique for a robot, whose components are within the 
nanoscale but the overall body size is in the microscale, is proposed; fabri- 
cation uses a laser beam from optical tweezers. Also, by using holographic 
optical tweezers, translation speed of 100 m/s and rotation speed of 
1140 deg/s is achieved (Fukada et al., 2013). The setup of this device by 
which the nanorobot was manufactured is shown in Fig. 3. 
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As expected after the great achievements of 2013, 2014 came with 
greater enthusiasm about nanorobots and wider coverage of related topics. 
First, for nanorobotics manipulation in single cell structure, analysis done by 
Shen and Fukuda (2014) discussed two ways of cell injection: by hand (an 
inefficient way) and automatically (dependent on robotics technology). For 
cell positioning, different techniques are represented using micro tools and 
magnetic nanorobots. The manipulation system will also be responsible for 
giving info about cell mechanical and electrical properties and behavior with 
the surrounding environment. Another research direction was taken in 
2014, which was drug delivery to cells using nanotechnology. Kumar and 
Kumar (2014) proposed a variety of emerging nanomaterials along with 
the methods to use them as drug delivery systems (DDS). The book dis- 
cussed the ability to use NPs for neurological disorder, cancer treatment, 
cardiovascular diseases, and stroke treatment. The book faced some 
challenges that were presented as the toxicity of materials and introduction 
of different particles when implemented in vivo (Kumar and Kumar, 2014). 
The use of flagella was revisited in 2014 with some advances. This study is 
unique in simulating and comparing efficiency of nanorobots with different 
body to flagellum ratios (BFR). Results showed that for single actuation, 
BFR greater than 0.2 is recommended, while for multipoint actuation, 
BFR less that 1 is recommended (Jia et al., 2014). 

Also in 2014, two different researches were conducted to provide com- 
munication techniques between a group of nanorobots to reach their target 
cells. As shown in the work done by Elsayed et al. (2014), the communica- 
tion technique between a swarm of nanorobots is approached based on a 
modified PSO algorithm as well as blood cells detection and avoidance algo- 
rithm. In other words, the proposal intends to aid a group of nanorobots in 
reaching their destination cells faster (Elsayed et al., 2014). Using different 
strategies, another communication technique among multiple nanorobots is 
studied based on evolution strategy (ES). Simulations among three strate- 
gies—straight strategy, swap strategy, and high strategy—verifies that high 
strategy showed higher effectiveness in arriving at the target area (Ahmed 
et al., 2014). The background provided from both contributions can help 
in finding the best strategy among all the methods mentioned. 

The development regarding fabrication of nanorobots never reaches an 
end. In 2014, two fabrication techniques were also presented in two 
researches. Focused ion beam (FIB) technique was used by researchers in 
Bao et al. (2014) to fabricate a nanorobot from platinum. Experiments of 
the movement of nanorobots in hydrogen peroxide solution were carried 
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out to test the effect of geometry on robot motion. As a result, the robot 
shows bidirectional movement behavior, on the contrary with previous 
studies showing unidirectional movement. Propulsion of this robot is done 
chemically, as shown in Fig. 4. In addition to FIB method, researches had 
proposed a process of fabrication and manipulation of nanorobots using laser 
exposure. Nanorobots made from carbon nanotubes (CNTs) were fabri- 
cated, and a cell puncture using infrared laser to generate heat and make a 
puncture point is experimented with (Hayakawa et al., 2014). This work 
showed the new use of laser in cell puncture, rather than limiting its use 
to fabrication and manipulation. 

Heading to 2015, a communication algorithm based on using acoustic 
signals was proposed to aid a swarm of nanorobots to coordinate themselves 
in non-Newtonian fluid with respect to target cancer cells. Based on the 
simulation results, the ratio of missed target decreased from 0.456 to 
0.019 after implementing the algorithm (Zhao et al., 2015). Additionally, 
Loscri and Vegni (2015) proposed the use of acoustic signals for communi- 
cation between nanorobots to reach the cell, destroy the tumor, and then 
inform the rest of the nanorobots, and simulate the behavior. Then, for 
advances in fabrication, nanorobots fabrication method using FIB and 
plasma sputtering technique (PST) was implemented in a new manner, 
but this time using platinum and gold elements. Robot movement was 
studied in water with different hydrogen peroxide concentrations while 
chemical reactions were the means of self-driving of the nanorobot; the 
higher the hydrogen peroxide concentrations, the higher the robot speed 
(Chen et al., 2015). The design of the nanorobot is shown in Fig. 5. 

Additionally, manipulation of NPs using a nanorobot probe was dis- 
cussed in 2015. The paper published by Korayem et al. (2015) mainly 
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Fig. 4 The chemical propulsion mechanism of a catalytic platinum nanorobot in hydro- 
gen peroxide solution (Bao et al., 2014). 
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Fig. 5 The design of the nanorobot fabricated from Au and Pt using FIB (Chen et al., 
2015). 





discussed manipulation of NPs moving them by an atomic force microscope 
(AFM) nanorobot probe. They made their experiments on particles of dif- 
ferent materials assuming desired position. The results aimed to limit the 
force that should be applied to reach a specific location in a typical time. 
In detail, the paper discusses the simulating and testing process supported 
by graphs. 

For construction of nanosized objects and components of nanorobots, a 
study developed by Daulbaev et al. (2017) described the process of obtaining 
polymer films by the electrospinning method. The idea to use a 3D printer in 
combination with an electrospinning machine was newly proposed, which 
made it possible to print the simplest nano size objects using polymeric 
fibers. 

Keeping up to date, in 2018, Farazkish (2018) discussed different reliabil- 
ity models of nanorobots, checking if their applicability is worthy or not. It 
also discusses the advantages of having trusted nanorobots and the barriers 
that should be overcome in order to get benefit from them. Moreover, a 
new aspect of research has come into play, which is the software for 
small-scale robots. In Tiemerding and Fatikow (2018), some software pack- 
ages were evaluated in a survey with regard to multiple parameters and 
queried for advantages and disadvantages. Accordingly, any of them can 
be chosen based on the presented issue. 

To sum up all the valuable contributions to the field of nanorobotics 
manufacturing, manipulation, and control, Table 1 shows the highlighting 
researches in a brief, organized timeline. 

Although efforts made in nanorobotics-related research have been signif- 
icant, there is still a gap between all the theoretical and experimental work 
presented and the possibility of applying nanorobotics in reality. This gap 
rises from the fact that there is no complete framework of the fabrication, 
manipulation, control, and simulation of nanorobots in vivo. Accordingly, 
contributions made that addresses the topics from different aspects are not 
homogenous with each other in a manner that allows their merging in 
one complete nanorobot. This gap is the motive for this chapter with the 
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Table 1 Summary of nanorobotics-related work. 


Year 


Authors 


Contribution 





2008 


2009 


2010 


2011 


2012 


2013 


2014 


Martel et al. 


Hla et al. 


Subramanian 
et al. 


Merina 


Martel 


Quader et al. 


Krol et al. 
Kosmas and 
Chen 
Aguilar 
Trihirun et al. 


Xu 


Thammawongsa 
et al. 


Fukada et al. 
Shen and Fukuda 
Kumar and 


Kumar 
Jia et al. 


Proposal to use flagellated magnetotactic bacteria in 
controlling and tracking hybrid nanorobots until 
reaching tumors 

Proposal to detect diseases by a swarm of nanorobots 
guided by PSO 

Modeling MATLAB simulation to verify the 
effectiveness of flagella propulsion in hybrid 
nanorobots 

Proposal to use nanorobots in heart transplant supported 
by suggestions for nanorobot fabrication and control 

Experimental results for using magnetotactic bacteria as a 
propulsion method to control movement of 
nanorobots 

Proposal of algorithm for enabling control and 
manipulation of nanorobots depending on nerve 
signals 

Path planning of nanoparticles to deliver insulin in order 
to help in treating diabetes 

Proposal of using external electromagnetic field to 
manipulate a robot to detect human breast cancer 

Proposal of theoretical considerations for using 
nanoparticles as targeted drug carriers analyzed for 
many factors 

Simulation on using nanorobots for repairing injured 
blood vessels walls using PSO 

Motion MATLAB simulation for artificial flagellum as a 
means of propulsion for nanorobots 

Proposal for using nanorobots in surgery and controlling 
their movement within the body by using optical 
tweezers and light beams 

Fabrication and manipulation of nanorobots using laser 
beam from optical tweezers with experimental results 

Proposal of methods for cell injection, cell positioning, 
and cell manipulation based on nanorobots and 
nanomaterials science 

Proposal of variety of emerging nanomaterials along with 
the methods to use them as DDS 

Simulation and analysis of using flagella in propulsion of 
nanorobots for varying body to flagella ratios to test the 
effect 





Continued 
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Table 1 Summary of nanorobotics-related work—cont'’d 
Year Authors Contribution 





Elsayed et al. Proposal for communication technique between 
nanorobots using modified PSO algorithm as well as 
blood cells detection and avoidance algorithm 

Ahmed et al. Proposal for comparing three evolutionary strategies— 
straight strategy, swap strategy, and high strategy—for 
communication between nanorobots 

Bao et al. Fabrication of nanorobots composed of platinum using 
FIB technology 

Hayakawa et al. Fabrication, manipulation, and cell puncture of 
nanorobots made from carbon nanotubes using laser 
exposure 

2015 Zhao et al. Simulation of communication algorithm using acoustic 
signals to aid a swarm of nanorobots to coordinate 
themselves in non-Newtonian fluid with respect to the 
cancer cells target 

Loscri and Vegni Simulation of using acoustic signals in communication 
between robots that destroy the tumor cells 


Chen et al. Fabrication of nanorobots from gold and platinum using 
FIB and PS technique 
Korayem et al. Experimental results for manipulation of nanoparticles 


moving by AFM nanorobot probe 
2017 Daulbaev et al. Fabrication of nanorobot components by 3D printing 
using polymer films by the electrospinning method 
2018 Farazkish Proposal of different reliability models of nanorobots 
checking if their applicability is worthy or not 
Tiemerding and Evaluation and comparison for software packages for 
Fatikow small scale robots regarding multiple parameters 





determination to provide a complete review about manufacturing nan- 
ocomponents, applicable designs of drivers, and previously applied missions. 
This work will be the bridge taking nanorobots from research labs to reality. 





3 Medical nanorobotic components design and 
selection 


Since the rise of the primary models of robot manipulators (Stewart, 
1965), the control issue of such frameworks has drawn the consideration of 
various scientists (Ammar and Azar, 2020; Azar et al., 2017, 2020a, b, 2018a, 
b, 2019a, b; Barakat et al., 2020; Azar and Serrano, 2019). The fabrication of 
nanorobots is, in fact, an assembly practice for different nanorobots 
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subsystems; for example, electronic chips, sensors, actuators, and drivers. 
These subsystems are manipulated by control systems to ensure that all sub- 
systems work in harmony so that the objective behind the fabrication of 
nanorobots is achieved. Obviously, different types of those subsystems 
should be chosen according to size, environment, and the task to be done. 
Surprisingly, within the medical nanorobots category itself, different subsys- 
tems are used based on the task (i.e., disease detection or treatment), the 
targeted area within the body (1.e., limbs, heart, etc.), the mechanism of 
diagnosis (i.e., a swarm of nanorobots or an individual one), the duration 
that the nanorobots will spend inside the body, and finally the disease itself. 
All these factors combined make it necessary to analyze thoroughly all the 
different methods that can be used to manipulate nanorobots and then design 
a specific-purpose nanorobot that can be assembled by integrating all these 
subsystems in a single assembled package. 

With the increasing interest in nanorobots among different fields, espe- 
cially medical applications, many methods have been suggested to fabricate 
nanoelectronics systems, nanosensors, nanoactuators, and nanodrivers. 
However, these methods have two concerns. The first concern is that not 
all of the materials used in the literature are bio-oriented to be used 
in vivo. The second concern is that, with the high specialty of research 
works, individual development of each method is proposed without exten- 
sive focused framework to aid nanorobot manufacturing. 


3.1 Nanoelectronic chips in nanorobots 


In the last century, advances in electronic chips were enormous and spanned 
multiple areas of development, such as new functionalities and smaller sized 
components. The microelectronic chip was first produced in 2000, which 
opens the door for researchers to think about nanoelectronic chips and mak- 
ing efforts in order to minimize the chip size. The transition between micro- 
electronics and nanoelectronics happens by 2010, when researches made a 
nanoelectronic chip with length 32 nm while also maintaining most of the 
functionality they planned to have (Hoefflinger, 2012). 


3.1.1 Nanomaterials-based nanoelectronics 

Nanomaterials is a broad term that include many materials with a wide range 
of applications. While designing an electronic system to function in a 
nanorobot, it is wise to check the opportunities provided by nanomaterial 
for having electronic components with such small size. For example, 
nanoparticles from alloying tin and silver are proposed to be used in lead-free 
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nano interconnects in electronic chips. Another example is using polymer 
nanocomposites for making embedded capacitors in circuits. Last but not least, 
nanomaterials have been proposed frequently to be used in nano interconnects 
and circuit adhesion and connections with the substrate (Wong et al., 2010), as 
shown in the process in Fig. 6 (Li et al., 2010). 

Nanopacking is the process of placing and integrating an electronic com- 
ponent on a nanochip. In nanopacking technology, some materials face lim- 
itation in being applied in nanosized chips. For example, copper in nano size 
below 22 nm is subjected to electro migration, so it fails on such a level. 
Accordingly, interests had been given to nonconventional materials to see 
their possibility for implementation in nanosized chips. One of these uncon- 
ventional methods is using graphene nanoribbons (GNRs) and CNTs in 
fabricating nano interconnects for electronic chips. Additionally, integration 
between these nano interconnects and complementary metal-oxide semi- 
conductor (CMOS) systems are possible, where the carbon-based intercon- 
nects open new opportunities for CMOS technology to minimize the size of 
chips and implement high frequency CMOS oscillators with reduced com- 
ponent heating (Chiariello et al., 2013). Vertical interconnects design is 
shown in Fig. 7 while horizontal interconnects design is shown in Fig. 8. 
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Fig. 6 Bonding of nanocircuits using nanomaterials based anisotropic conductive films. 
(From Li, Y., Moon, K.., Wong, C., 2010. Nano-conductive adhesives for nano-electronics 
interconnection. In: Wong, C., Moon, K.S., Li, Y. (Eds.), Nano-Bio-Electronic, Photonic and 
MEMS Packaging. Springer, Boston, MA, with permission.) 
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(A) (B) (C) 
Fig. 7 Vertical interconnects in (A) the structure of interconnects, (B) the cross section of 
an interconnect with single walled CNTs, and (C) the cross section of an interconnect 
with multi-walled CNTs. (From Chiariello, A.G., Maffucci, A., Miano, G., 2013. Temperature 
effects on electrical performance of carbon-based nano-interconnects at chip and package 
level. Int. J. Numer. Model.: Electron. Netw. Devices Fields 26 (6), 560-572, with permission.) 





(A) (B) (C) 

Fig. 8 Horizontal interconnects in (A) the structure of interconnects, (B) the intercon- 
nects made by CNTs, and (C) the interconnects made by GNRs. (From Chiariello, A.G., 
Maffucci, A., Miano, G., 2013. Temperature effects on electrical performance of carbon- 
based nano-interconnects at chip and package level. Int. J. Numer. Model.: Electron. Netw. 
Devices Fields 26 (6), 560-572, with permission.) 


3.1.2 Nano optomechanical systems for nanoelectronic chips 

Briefly, optomechanics is a field of science concerned with the effect and 
interaction between optical radiation and mechanical systems through radi- 
ation pressure. Particularly, the relation between a laser beam and mechan- 
ical vibrations is an example of optomechanics applications that is applied at 
micro and nano scale resonators. As medical nanorobots experience the need 
to measure mechanical movement of other particles in the swarm or particles 
inside the body, an optomechanical system integrated on the chip for sensing 
that mechanical displacement provides a good mechanism to implement 
robot functions and tasks. Without optomechanical systems, electrical 
methods of measuring the displacement would have been the available solu- 
tion even with its limitation for nanorobot size. Nevertheless, the external 
optomechanical systems—when they are not integrated on chip—sufter 
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from diffraction of laser while being in use in nanoelectromechanical systems 
(NEMS). Thus, the on-chip solution offers a good design for medical 
nanorobots that aims to measure movement while maintaining its small size 
(Diao et al., 2017). 


3.2 Nanosensors in nanorobots 


For fabricating a bio-nanomedical robots for operating in vivo, high accu- 
racy in functionality, operation, and communication between the robot and 
the driving mechanism is needed. Indeed, all these targets are to be achieved 
using sensors. Sensors are essential to locate the robot with respect to other 
particles or other robots in a swarm of nanorobots. 


3.2.1 Polymer clusters as nanosensors 

Nano switches can be a great option for nanosensors in bio-applications and 
nanorobots. They have been proposed in the literature for usage in ion con- 
centration measurements in cells. Particularly, nanosized polystyrene clusters 
are being used as switches for sensing purposes based on optical manner. This 
optical detection is accompanied with the use of florescent dyes to establish a 
detection and recognizing mechanism as shown in Fig. 9 (Méallet-Renault 
éteal,,. 1999). 

Although being a promising and good sensing methodology that is spe- 
cial for cells, the size of polymer nanoparticles used for making the 
nanocluster in literature is 100 nm. Further research and trials to make 
the size smaller is recommended before implementation in the detection 
and diagnosis nanorobot. 


Excitating light Excitating light 
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Fig. 9 Polymer clusters nano switches used as nano sensors in living cells for ion detec- 
tion. (From Méallet-Renault, R., Denjean, P., Pansu, R.B., 1999. Polymer beads as nano- 
sensors. Sens. Actuators B Chem. 59 (2-3), 108-112, with permission.) 
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3.2.2 Silver-based nanocluster nanosensors 

Nanoclusters (NCs) are the combination of several NPs and atoms of one or 
more elements in one cluster or package. Throughout the years, interest had 
been given to fabricating silver nanoclusters for their high sensitivity in 
detecting lead ions in solutions and living cells, which gives them great 
potential for usage as nanosensors in medical nanorobots. However, the 
rapid development has faced a challenge in the instability and long prepara- 
tion time for fabricating silver-based NCs. Fortunately, a proposal made by 
Wang et al. (2017) illustrated a novel method for fabrication with shorter 
time and high stability of clusters in terms of time, metal and pH stability. 
That method depends on using chemical agents in order to speed the chem- 
ical process of nanocluster aggregation. 


3.3 Nanoactuators in nanorobots 


Nanoactuators are mechanisms for imparting movement and actuation in 
nanostructures. Based on this concept, they are crucial parts in nanorobots 
used in medical applications in order to allow the robot to move and interact 
with living cells and particles. As wide as the range of applications for 
nanoactuators in the medical field, various research areas and methods are 
discussed in literature for fabricating nanoactuators. Actuators, in general, 
are classified according type of motion as rotary or translational actuators. 
On the nano scale, actuators are mainly dependent on a reaction or factor 
level like moisture, temperature, or PH level. 


3.3.1 Electrostatic force-based nanoactuators 

Gripper is a kind of end effector that can be used and implemented in 
nanorobots. In the work done by Fujiwara et al. (2016), layers of graphene 
are folded using a nanomanipulator for being used as a nano gripper driven 
via electrostatic force. This process is in fact divided into two sub processes: 
gripper fabrication and actuation implementation. The gripper is made by 
forming a pattern at first then making cuts in the pattern and folding them. 
Afterwards, energizing an electrode probe and the graphene gripper by dif- 
ferent polarities results in the movement and manipulation for the gripper. 
The two-step process is shown in Fig. 10, where major stages are 
highlighted. This complete design can be an add-on to the structure of 
any nano medical robot for permitting the robot to interact and grab cells 
and particles in vivo. 
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Fig. 10 Graphene actuator with electrostatic actuation illustrated as in (A) the unfolded 
graphene pattern, (B) the folded graphene pattern, and (C) the actuation method 
(Fujiwara et al., 2016). 


3.3.2 CNTs-based nanoactuators 

Surprisingly, in addition to being used in fabricating nanoelectronic chips 
and nanosensors, CNTs play a role in fabricating nanoactuators. The design 
of this nanoactuator is based on a cantilever beam design for a manipulator 
reinforced by CNTs and actuation using electromechanical coupling, as 
shown in Fig. 11 (Yang et al., 2014). 


3.3.3 Viral protein-based nanoactuators 

Focusing on getting use of biomaterials and biocomponents in the fabrica- 
tion of nanoactuators, a proposal for a medical nanorobot for viral detection 
was made done by Dubey et al. (2003). The effective and significant method 
has the same actuation concept as the envelope proteins change of a virus 
while it tries to penetrate a cell. The proposed actuation method depends 
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Fig. 11 Structure of CNTs-reinforced nanomanipulator actuated by electromechanical 
coupling. (From Yang, W.D., Wang, X., Fang, C.Q., Lu, G., 2014. Electromechanical coupling 
characteristics of carbon nanotube reinforced cantilever nano-actuator. Sens. Actuators A 
Phys. 220 (2014), 178-187, with permission.) 
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on using similar proteins and controlling the conformational changes in the 
actuator movement using environmental and experimental conditions, 
which can cause a linear movement of 10 nm (Dubey et al., 2003). 


3.3.4 Prefoldin-based nanoactuators 

From a biological point of view, prefoldin is a type of protein used as a molec- 
ular chaperone (proteins aiding in processing molecular structures) in single- 
celled microorganisms as well as multicelled microorganisms. Structure of 
prefoldin consists of multiple coils of proteins with a cavity at the middle 
of the structure. In a proposal made by Ghaffari et al. (2010), a design for a 
bio-nanoactuator used to hold bodies in the nano size intended to use the pro- 
tein itself as an actuator, which presented a great solution for bio-safety and 
healthiness when used in vivo. Using simulation, the research established that 
some segments in the prefoldin are more flexible than others, a result that can 
further assist in controlling the actuator movement (Ghaffari et al., 2010). 


3.3.5 Focused ion beam manufactured, thermally driven nanoactuators 
This specific type of actuator is used to drive a bimorph. In fact, bimorph is a 
cantilever shaped structure consisting of several layers and, by design, it is 
allowed to move at one end. This bimorph is made using a focused ion 
beam-chemical vapor deposition (FIB-CVD) process, in which fabricating 
nano structure is done using ion energy for localizing and adding structure. 
The actuation method of the bimorph is done using thermal energy where 
the actuation process itselfis a result of thermal strain. The actuator is connected 
to a plate that is heated electrically, and transfers heat energy to the actuator. 
Controlling the current in the circuit gives a direct control over the plate heat 
and thus the manipulator strain and movement (Chang et al., 2007). Fig. 12 
demonstrates the setup of the manipulator for thermal actuation, while 
Fig. 13 illustrates the structure of a FIB manipulator with its materials. 
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Fig. 12 Setup for thermal actuation of nanostructured bimorph (Chang et al., 2007). 
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Fig. 13 Structure of nanosized bimorph actuator (Chang et al., 2007). 





4 Applicable designs 


As a proof of nanorobots’ achievements, several designs have been 
approached and experimentally tested for its validation. Indeed, many of 
those designs have been conducted for nanorobots to serve medical field 
requirements and desires. The following are the designs that are most com- 
mon in the recent progress. 


4.1 Drug delivery system using hydrogel bilayer 


One of these designs is self-folding hydrogel bilayer, which is especially 
suited to drug loading, encapsulation, and transport, as it is able to absorb 
several times more drug solution than its dry weight (Huang et al., 2016). 
The research done by Huang, Petruska, and Nelson handles the problem 
that hydrogels perform drug prerelease before reaching the targeted area 
of cells, due to high water content; it then introduces a mechanism 
preventing this phenomenon without affecting drug loading efficiency 
(Huang et al., 2016). Hydrogels have many advanced properties such as 
self-folding capability through stress-induced bending, exceptional drug 
loading ability, forming 3D structures from 2D patterns, and ability to con- 
trol drug release rate (Fusco et al., 2015). This process is only compatible 
with drugs that are insensitive to UV-light. 
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The proposed design is based on a hydrogel bilayer that is composed of a 
drug-loaded layer and supporting layer. The first is a thermally responsive 
hydrogel with a relatively high-swelling property and is responsible for drug 
carry and temperature dependent folding control. The second degradable 
magnetic nanocomposite representing the supporting layer and concerns 
about folded shape and enabling the tube to be magnetically manipulated. 
Encapsulation occurs by raising the temperature to body temperature of 
37°C, causing the drug-loaded layer to be isolated from the external sur- 
rounding environment. Then, the tube is magnetically guided to the target 
area without leaking drug on the way. Drug release is introduced once the 
supporting layer is degraded causing the tube to unfold (Huang et al., 2016). 


4.1.1 Hydrogel bilayer fabrication 

The bilayer is fabricated through several steps using photolithography. First, 
a magnetic field of 10 mT is applied in the planar direction for 1 min to align 
the magnetic NPs in the nonresponsive pregel solution. The direction of the 
applied magnetic field determines the structure folding direction. A non- 
thermally responsive pregel solution is polymerized by UV light (365 nm, 
3 mW/cm’) between a glass mask and a 10-m thick spacer for 1.5 min 
to form a supporting layer. The spacer is then removed, and the thermally 
responsive pregel solution is introduced into the space between the photo- 
mask and the new 30-pm thick spacer substrate. The thermally responsive 
layer below the supporting one is polymerized by UV-exposure for 2 min. 
After UV curing, the cell is opened, and the bilayers attached to the photo- 
mask are released. Note that they are folded into tubes once immersed 
in water. 

Regarding the analysis of hydrogel nanocomposites, characterization is 
achieved by weighing them in different temperatures starting from 22°C, 
increasing to 40°C. Each layer goes through the cycle of polymerization, 
drying, and then hydration using deionized (DI) water at room temperature, 
then it is kept in a water bath with a controllable temperature. This process 
provides enough information about dried and swollen weights to determine 
the weight swelling ratio (WSR) of hydrogel nanocomposite using Eq. (1): 


_M—My 


d 


WSR (1) 


where M, is dried weight, M, is swollen weight, and WSR is weight 
swelling ratio. 
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Another analysis for drug release at room temperature and body temper- 
ature is performed as a part of testing criteria. Thermally responsive hydrogel 
disks, with a diameter of 7 mm and thickness of 400 pm, are, accordingly, 
prepared to analyze the drug encapsulation and leakage. Between two glass 
slides that are separated by a stacked cover glass, hydrogel polymerization is 
sustained for 2 min. Afterwards, it is immersed in DI water for two days to 
allow hydrogel to detach from the glass slides. After cutting it in defined 
diameters, gel disks are exposed to air for a day and again immersed in a 
model drug solution (Brilliant Green, BG in PBS solution, 1 mM) for a 
day at room temperature. Disks are removed from the solution and again 
immersed in DI water for 10 s to clean up any residue and immersed in 
300 of PBS solution within an Eppendorf; release is monitored at room tem- 
perature for a day and then all samples are left in monitoring at room tem- 
perature for 10 days—the assumed period for a sample to release all drug 
quantity contained. The PBS solution and any release of BG is collected 
at defined periods and measured by UV-VI spectroscopy at the 622 nm 
wavelength and new solution is added to achieve best sink conditions. 

Doing the drug release analysis at room temperature requires following 
steps of immersing bilayers in water bath at a temperature of 45°C for 1 min. 
As a result of placement in a temperature that is higher than the 
lowest-critical-solution temperature (LCST) of NIPAAm, the internal 
water is pressed out and removed with tissues. Bilayers are then placed in 
a 1 mM BG solution and left to absorb the drug for a day, after which, they 
are immersed in DI water for 10 s, rinsing off any residuals. Finally, they are 
introduced to 300 UL PBS solution within an Eppendorf and release progress 
is monitored for a week considering the collection, measuring, and replace- 
ment of the solution each 5 min. 

Regarding analysis at body temperature, the same process applies, with 
an additional step of heating bilayers to body temperature of 37°C for an 
hour and then removal from the BG solution. Degradation characterization 
is performed for individual bilayers and supporting layers. They are 
immersed in 1 mM concentrated sodium hydroxide (NaOH) solution to 
boost progress of the process and kept at body temperature for four days, 
mimicking the in vivo environment. According to monitoring and obser- 
vation of previously conducted analysis, the behavior of the hydrogel mech- 
anism is provided. It applies the property of self-folding due to coupling two 
material layers—drug-loaded layer and supporting layer—that have different 
WSR. In this context, the supporting layer has the low WSR while the 
drug-loading layer has a relatively high ratio. Changing temperature affects 
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the behavior of the mechanism in different cases. Generally, WSR of the 
drug-loaded layer decreases as temperature increases, causing an unfolding 
process to occur. When temperature is set to a value higher than the LCST, 
the hydrogel bilayer folds in an opposite sense, giving constant WSR for the 
two layers. Moreover, having ambient temperature that is much lower than 
the LCST causes the bilayer to fold in a cylindrical manner, forming a tube 
with the drug-loaded layer exposed to the surrounding environment; this 
scenario is advantageous in the drug release process. In contrast, when tem- 
perature is higher than LCST, the bilayer folds in the opposite way, hiding 
the drug-loaded layer inside and preventing high rate leakage of the drug; 
this scenario is beneficial for motion until the device reaches the targeted 
area. Fig. 14 shows a hydrogel bilayer capsule at different temperatures, giv- 
ing three different behaviors. Self-folding occurs at room temperature while 
refolding happens at body temperature. 

Thermally responsive release of hydrogel drug shows a step of success as it 
decreases the leakage to approximately 20% at high temperature, although it 
approaches 50% at room temperature. In other words, leakage and amount 
of loaded drug depends on pores size, which slightly changes with temper- 
ature. Accordingly, hydrogels initially release an amount of drug in high 
temperatures that is higher than the amount released at room temperature 
due to pores squeezing. Hydrogels release 70% of loaded drug in two days 
when left at room temperature; however, they releases only about 30% of it 
when left at body temperature. Actually, encapsulation of drugs can be 
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Fig. 14 Hydrogel capsule at different temperatures. 
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enhanced by isolating the drug-loaded layer such as implemented in the 
behavior of refolding or by adding an extra supporting layer to limit diffusion 
rate of drug. Degradation of layers differs according to which layer is meant 
to degrade. For supporting layers, it takes only 1 h to completely degrade, 
while drug-loaded layer takes about four complete days to completely 
degrade, which is about 72 times the duration required for the 
supporting layer. 


4.2 Artificial bacterial flagella 


The studies conducted on the micro/nano organisms that live in the low 
Reynolds number fluids proved that those organisms have a wide range 
of swimming techniques. The two most reliable techniques for micro/nano 
organisms’ nonreciprocal motion are the flexible oar motion and the cork- 
screw motion. The flexible oar motion is mainly found in the motion of 
eukaryotes as they propel themselves; once activated, a propagated wave 
is generated by an active flagellum. The corkscrew motion is mainly pres- 
ented in some prokaryote bacteria. This motion contains a group of flagella 
driven by helical shaped motors. Given the recent advancement in nano- 
technology, scientists are working to fabricate devices that are able to propel 
in the micro and nano scales. The main obstacles that face the scientists dur- 
ing working at these scales are the power sources and actuations methods. 
Operating on nano scale made it impossible for the traditional power sup- 
plies to be compatible with the size of the robot that needed to be directed in 
biomedical applications. Seeking an acceptable solution to overcome this 
obstacle, two main approaches were improvised: depending on external 
power supply or harvesting energy from the surrounding environment. 
Both approaches proved to be efficient on the micro and nano devices that 
operates in low Reynolds number liquids. Those swimmers are using chem- 
ical locomotion to apply the approach of harvesting the energy from chem- 
ical components in the environment. Another type of swimmer benefits 
from being driven by a nanomotor; these are also known as artificial swim- 
mers, as they increase their swimming velocity to reach 100 body lengths per 
second, compared to the fastest animal on earth, the cheetah, whose speed 
reaches approximately 25 body lengths per second. Using external power 
supply introduces the artificial swimmers with the advantage of being able 
to function with the least energized fluids (Zhang et al., 2009). 

The first introduced remotely controlled helical swimmer was in 1996 
and it was 0.15 mm with a permanent magnet fixed on one end, then it 
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was developed based on the motion of spermatozoa to be a micro swimmer 
with a paramagnet that enables its attraction to a blood cell. After being 
attached to the blood cell, oscillating magnetic waves are applied to perform 
a propelling motion around the cell similar to the motion of eukaryotic fla- 
gellum. The modern advancement in helical swimmers is based on the same 
concept of motion, yet with the diameter of 200 nm and length of 2 pm, 
which enables the swimmers to operate on the cellular level with accurate 
position control and high velocity. Another actuation method for micro/ 
nano swimmers can be harnessing the natural bacteria and using it as a power 
source. The required force to move the swimmer can be generated by 
molecular motors attached to these bacteria, this force can drive the swim- 
mer randomly until it is controlled by external excitation methods such as 
light and magnetic fields. Focusing on the artificial bacterial flagella (ABF) 
as nanorobots, there are several concerns about employing them in sensitive 
applications such as surgeries and different biomedical fields. Those concerns 
can be defined as the precise motion control, separation of the individual 
swimmer from the associated group, accurate force and torque control of 
ABF, and the optimization of the swimmer’s shape to fit the desired appli- 
cation. Due to the sensitivity of the application that uses nanorobots, missing 
or losing control of one of those parameters can result in serious conse- 
quences. Fig. 15 illustrates the major steps to use the ABFs in different 
applications. 


4.2.1 Fabrication and magnetic actuation 
Controlled fabrication 


The recent ABFs have a nanoscale helical propeller that is directly actuated 
by an external magnetic field and are able to rotate around their helical axis. 
Using a magnetic field as an actuation technique makes the design simpler, as 
it eliminates the need to create a unique relative motion between the tip and 
the tail of the ABF. In spite of the difficulties of fabrication in the micro and 
nanoscales, due to the 2-D patterning of the lithography technique, a variety 
of nanohelix fabrications have been achieved based on the bottom-up fab- 
rication approach such as the coiled CNTs, ZnO semi conductive 
nanohelices, and helical shape polymer fibers. However, although those fab- 
rications are widely used, their geometry cannot be controlled accurately. 
New fabrication techniques were adopted to generate complicated 3-D 
nanostructures using direct laser writing, yet it was found not to be suitable 
with batch processing of 3-D structures. Another ABF fabrication technol- 
ogy has proved to be beneficial in generating 3-D nanostructures from 
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Fig. 15 The roadmap for ABF. (From Zhang, L., Peyer, K.E., Nelson, B.J., 2010. Artificial bac- 
terial flagella for micromanipulation. Lab Chip 10 (17), 2203-2215, with permission.) 


planar thin films. This technology is based on the top-down fabrication 
technique combined with a self-organizing step to introduce what is called 
the self-scrolling technique. The self-scrolling technique is known for its 
flexibility as the 3-D dimensions of the generated structures can be con- 
trolled and scaled up or down. Self-scrolling technique also enables the 
changes in the geometrical parameters of the helix to be controlled precisely. 
Moreover, a wide range of materials can be implemented in the structures 
produced by this technique, so it is considered as an adaptive fabrication 
technique (Zhang et al., 2009; Peyer et al., 2014). 

Self-scrolling technique is used to fabricate two different types of ABFs: 
An InGaAs/GaAs semiconductor bilayer tail and InGaAs/GaAs/Cr semi- 
conductor metal tri-layer tail. The studies revealed that InGaAs/GaAs/Cr 
tail design is preferable for its mechanical properties and flexible manipula- 
tion and motion. The design consists of a magnetic head that uses Cr/Ni/Au 
as a composite of the thin metal layer forming the head. The thickness of the 
three-metal composite Cr/Ni/Au is 10/180/10 nm, respectively. Another 
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fabrication technique used to introduce another type of artificial helical nano 
propeller is the glancing angle deposition (GLAD). The technique is used to 
fabricate ABF helical tail by evaporating permanent magnet film on one side 
of the swimmer. The GLAD technique requires specific materials to be 
deposited by the vapor deposition, and it is mandatory that the helical tail 
of the nano propeller is coated with the magnetic film, which results in min- 
imizing the area of the active surface. Despite the high yield of GLAD tech- 
nique, the self-scrolling technique guarantees more flexibility in material 
selection (Peyer et al., 2014). 


Magnetic actuation 
Due to the self-propelling motion of the ABF, the soft magnetic head of the 
ABF experiences a continuous torque given by Eq. (2): 


Ty = Ho VM x H (2) 


where Vis the volume, M is the magnetization, His the applied field, and po 
is the permeability of the free space. 

In order to actuate the ABF, the magnetic field needs to be rotated per- 
pendicularly on the helical axis. As the head of the ABF is made of nickel, it is 
magnetized along the diagonal axis, which generates an increasing torque 
related to the angle between the plate and the applied field. The maximum 
magnetic field is calculated based on Eq. (3): 


i =n : 


where B is the field vector. 

The amount of field strength generated based on Eq. (3) will be approx- 
imately 2 mT. In order to apply higher torque on the helical axis, stronger 
magnetic material is needed which will be beneficial in controlling and 
steering the swimmer. 


Motion control 

Steering precision Due to the motion behavior of ABF and the 
corkscrew-like movement, moving backward and forward is performed 
by the rotary motion of the spiral tail and can be switched by reversing 
the direction of rotation or by changing the direction of the magnetic field. 
Changing the angle of direction of the effecting rotating field B will steer the 
propeller ABF in the desired direction. The steering technique is based on 
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changing the perpendicularity of the magnetic field, which will, in turn, 
reposition the ABF to be perpendicular to the rotating magnetic field 
(Zhang et al., 2009). 


Shape optimization Seeking the optimum swimming performance, many 
experiments were deducted to optimize the shape of the helical artificial 
swimmer. Recent studies have proved that even with the same input fre- 
quency and by reducing the diameter of the ABFs from 2.8 to 0.8 pm and 
the length of the propeller from 30 to 8 pm, the swimming relative velocity 
of the ABFs will increase. Table 2 shows the dependency of the swimming 
velocity on the diameter and the length of the ABFs. The three ABFs were 
given the same input frequency, equal to 10 Hz (Zhang et al., 2009). 

As shown in Table 2, both the relative velocity and the ratio of the tran- 
sitional displacement increase with the smaller dimensions of the helical 
swimmer, which results in more efficient propelling ABF. More experi- 
ments were conducted, and it was proved that an ABF with a larger head 
will swim more slowly because of the higher fluidic drag; in contrast, it 
has larger maximum swimming velocity due to the magnetic torque pro- 
duced by the input frequency. With specific tail length, the relation between 
increasing the magnetic torque and decreasing the fluidic drag can be 
adjusted to gain the maximum velocity (Zhang et al., 2009). 

Another model for the ABF can have a spherical head and helical tail 
with diameters of d and 20, respectively. In order to study the effective 
parameters on the motion of the ABF, the helical tail is considered to be 
the reason behind the generated forward propulsion of the swimmer. As 
the tail consists of incredibly small cylindrical elements, the equilibrium 
force lays between the drag force and the driving force, which affects the 
swimmer’s tail. The second effective parameter is the spherical head of 
the swimmer, which creates a torque and a resistive drag force that varies 
linearly with the rotational speed and the forward velocity of the ABF, 
respectively. Eq. (4) relates the maximum velocity with the maximum tor- 
que induced by the ABF. 


Table 2 Comparison between velocities of different ABFs. 





Number of | Length Diameter Velocity Relative Ratio 
turns (n) (L/jum) (d/um) (v/jum s~') velocity (v/L) (v/Lf) 
ABF1 3.5 30 2.8 6 0.2 0.02 
ABF2 3.5 8 0.8 4 0.5 0.05 


ABF3 4 2 0.2 2 1 0.1 
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b 


Vmax = bP —ac Tmax (4) 


where a=1.5x 10’, b= —1.6x 10 "*, and c=2.3 x 10” are the param- 
eters of propulsion. 


4.3 Rotating nickel nanowire 


Another approach for manipulating micro objects in the biological field is to 
use rotating nickel nanowires actuated by a rotating magnetic field. This 
approach enables the nickel nanowires to propel near solid surfaces using 
tumbling motion, as shown in Fig. 16. Manipulation on the cellular level 
consists of two main strategies: noncontact manipulation and contact manip- 
ulation. The first strategy is based on remote manipulation and steering using 
wireless techniques such electric field effect, directed laser beam, or acoustic 
force implementation, while the second contact manipulation strategy is 
based on direct contact between the end effector and the micro objects. 
Applying those strategies on the cellular level ensures precise object control 
and manipulation; however, they require complex calculations and accurate 
experimental setups. The complexity of applying the contact approach on 
the nano or even the micro scale relies on the effect of gravitational forces 
on that scale and the Van Der Waals force; it is a distance-dependent force 
generated by the interactions between the molecules. On the other hand, 
applying noncontact manipulation on that scale is simpler due to the absence 
of the mechanical contact between the end effector and the targeted cell. 
Additionally, the noncontact approach is more applicable on the cellular 
level as it provides smooth and gentle handling for the targeted cells using 
fluid flow control techniques. Controlling the flow is mainly done by induc- 
ing magnetic field with low strength using magnetic nanowires (NWs), spe- 
cifically nickel nanowires (Ni NWs). It was also proved that Ni NWs can be 
used in producing hypothermia in living cells as they can be heated by radio 
frequencies that reach 810 MHz (Zhang et al., 2012). 


] 
_— % | 


SS OF 
(A) (B) (C) (D) (E) 
Fig. 16 Sequence of tumbling motion (Zhang et al., 2012). 
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4.3.1 Fabrication and characterizations 

The idea of Ni NWs is developed by using a template-assisted electrochem- 
ical deposition technique. The template is fabricated from anodic aluminum 
oxide (AAO) filament that contains channels with pore sizes of 100 and 200 
nm. The field emission scanning electron microscopy (FESEM) ofa Ni NW 
array implanted in AAO template is shown in Fig. 17. The characterization 
of those implanted arrays can be simply performed using a vibrating sample 
magnetometer. 


Magnetic actuation 

Seeking accurate control and steering for the NWs, three orthogonal Helm- 
holtz pairs of coils are used in order to obtain a uniform magnetic field. The 
induced magnetic field strength reaches approximately 15 mT, which is more 
than enough to perform manipulation processes on the cellular level. The 
actuation process starts with turning on the rotating magnetic field, which 
in turn rotates the Ni NWs within the same plane of the generated magnetic 
field. The rotation of the NWs occurs due to the driven torque (f,,,) that tends 
to align the axis of the NWs with the long axis of the induced field. The rela- 
tion between the uniform field and torque was illustrated in Eq. (1). As for the 
directing the NWs, adjusting the rotation plane of the magnetic field is suf- 
ficient to obtain precisely steered NW (Zhang et al., 2012). 





Fig. 17 Micrograph of Ni NW arrays implanted in an AAO template. (From Zhang, L,, 
Petit, T., Peyer, K.E., Nelson, B.J., 2012. Targeted cargo delivery using a rotating nickel nano- 
wire. Nanomed.: Nanotechnol. Biol. Med. 8 (7), 1074—1080, with permission.) 
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Unlike the contact manipulation technique, applying the noncontact 
manipulation on the cellular level is simple, as it enables pushing and delivery 
processes to be performed based on less complicated calculations. In order to 
push and manipulate a micro object without direct contact between it and the 
end effector, equal velocities of both the end effector and the micro object are 
essential. Reducing the interaction forces and friction forces between the end 
effector and the object results in a smooth pushing process with smaller forces 
applied on the micro object. Performing noncontact manipulation is based on 
two main parameters: the rotational speed of the NW and the interaction 
force applied on the manipulated object. Controlling those parameters can 
be done by adjusting the rotation velocity of the NW to generate the desired 
force on the micro object through generating proportional fluid flow field. 
Given this relation, adjusting the rotational velocity of NW is crucial to deter- 
mine the preferable force to be applied on the micro object in order to move it 
with the same velocity as the NW. Applying this principle requires the axis of 
the NW to be aligned with the axis of the targeted object which introduces 
some challenges due to the surface roughness of the targeted micro object and 
other conditions that make it difficult to avoid drifting. On the other hand, 
performing noncontact pulling manipulation results directly in nearly equal 
velocities of the NW and the micro object, with fewer imperfect boundaries 
(Zhang et al., 2012). 


4.4 Positioning and control 
4.4.1 Control by gradient field 
The magnetic torque and force are dependent on the magnetization and vol- 
ume of the object being analyzed (Schuerle et al., 2013). It is possible to 
remove the dependence on volume and material properties to yield normal- 
ized magnetic force positioning of the nanorobot, as in Fig. 18A, described by: 

















F,,=(m-V)B (5) 
OB, 0B, OB: 
Ox Ox Ox i 
dB, 0B, dB.| |™ m B, 
F,, = 3 Fy aye m, = m B, I (6) 
yoy Oy ae m'B. 
0B, 0B, OB. 
Oz Oz Oz 


This aligns the nanorobot magnetic moment vector m with the magnetic 
flux density vector B at current vector I in the coils. In Eq. (5), all spatial 
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(A) (B) a 


Fig. 18 (A) A circular loop carrying a current I of a magnetic field evaluated at point 
P(x, y, Z). (B) Illustration of forces acting on the nanorobot flow in a non-Newtonian fluid 
(Ghanbari et al., 2014). 


derivatives of the magnetic flux density are evaluated at the location of the 
nanorobot. The components of the magnetic field can be transformed to the 
global coordinate system where the magnetic field of n coils is superimposed 
according to: 


B(P) = SBE (7) 


where P is the position vector. 
Combining Eqs. (6), (7) gives: 


B(P) 
Pa |- mB IP) I=C(m, P)I (8) 
m'B.(P) 


For a desired magnetic field and magnetic force, one can solve Eq. (8) using the 
inverse of matrix C to obtain currents through coils for exact positioning as: 


1=C(m, P) Pe | 0) 
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If the desired force, magnetic moment, and position of nanorobot are deter- 
mined, the current in the coils can be calculated by Eq. (9). This equation 
generally describes the positioning and the manipulation of the nanorobot 
by any coil configuration exerting magnetic force. 

A nanorobot can be positioned by a magnetic force in the three trans- 
lational DOF in a non-Newtonian fluid, where the equation of linear 
motion for motion is obtained by using conservation of linear momen- 
tum as: 


Fy, + Fy + Farag + Fy = ma (10) 


where the applied magnetics force F,,, the fluid hydrodynamic drag Fyyqg, the 
gravitational force F,, and the buoyancy force F, on the nanorobot shown in 
Fig. 18B are equivalent to its mass m times its acceleration a. 

The nanorobot’s drag force varies linearly with its velocity and acts in the 
opposite direction of the velocity. Accordingly, the magnetic force position- 


ing the nanorobot using the position vector P will be: 
F,, = mP — Fy — Farag — Fy (11) 


where the second time derivative of the nanorobot position P represents its 
acceleration. 

All terms that contain uncertainty, such as the contact forces, van der 
Waals forces, and electrostatic forces, can be represented by the parameter 
Has: 


H = (m—1mo)P — (Fe + Farag + Fs) (12) 
By substituting with Eq. (11) into Eq. (12): 
H=EF,,—moP (13) 


Considering the time delay estimation methodology (TDE), which can con- 
trol systems with nonlinearities and uncertainties by a straightforward gain 
design (Jin and Chang, 2009), the parameter H can be estimated based 
on the previous time-delayed value of the system variables, as the time delay 
6 tends to zero, which is given as follows: 


H(t) = H(t—6) = F,,(t —6) — moP(t — 6) (14) 
Based on Eq. (13), the input control force F,, is given as: 


F(t) = mV +H (15) 
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where Visa function of the desired position vector Py, the proportional gain 
K,, and the derivative gain K,, given as: 


V =p, + K,(Pi— P) — Kp(Pa—P) (16) 


where the position error can be defined as e = P, — P. 
Substituting by Eqs. (15), (14) in Eq. (16) will yield: 


F,(t) = mo| Py ite K,é _ Kpe| + Fils _ 6) = moP(t _ 6) (17) 


The gains, K, and K,, are diagonal matrices designed individually in three 
directions to cope with the dynamics of the nanorobot in the three direc- 
tions, giving an error of a desired response. As shown in Fig. 19, the control 
system requires continuous position information P(t), and its time deriva- 
tives until acceleration P(t). 


OctoMag 

This device, shown in Fig. 20, can navigate micro and nanorobots in bodily 
fluids to enable a number of minimally invasive diagnostic medical proce- 
dures. The OctoMag was designed to optimize the manipulability of the 
magnetic field, as it has five degrees of freedom (5-DOF) wireless magnetic 
control, which decomposes to 3-DOF position and 2-DOF pointing orien- 
tation. Accurate force control will be able to levitate the robot against its 
own weight or to push with a specific force. On the other hand, torque 
is needed to rotate the robot, and a low magnitude of torque applied in 
the correct direction will give the correct control effort. 


Delay 5 
Desired acceleration <) 
+ 


hd ; Position 
arene ‘C) > DP +P “HD -[ som 
dynamics 


as 
Desired position C+ 


Fig. 19 Scheme of the TDE control system used in the simulation, where m_0 was tuned 
for optimum performance of the TDE controller (Ghanbari et al., 2014). 
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Fig. 20 OctoMag system for intraocular microrobots control (Kummer et al., 2010). 


The OctoMag electromagnetic system was proposed for the control of 
intraocular microrobots (Fig. 20) with a camera fitted down the central axis 
to image the robot in the eye, where an eyeball is at the center of the system’s 
workspace (Kummer et al., 2010). Using an OctoMag prototype, a robot has 
been injected into the lapine vitreous humor, where a disposable 
planoconcave vitrectomy lens is placed on the eye to increase visibility 
(Fusco et al., 2014). Increasing the size of the prototype system to accom- 
modate a human head requires more powerful current amplifiers to generate 
the same magnetic field strength, because the strength of the field gradients 
attenuates with a factor by which the system is scaled (Kummer et al., 2010). 


4.4.1.1 MiniMag 

The MiniMag is a magnetic actuation system for manipulating micro and 
nano swimmers with translational motion along their orientation axis. It 
consists of eight electromagnetic coils focused on the center, and arranged 
in the form shown in Fig. 21A and B. By passing a current through the coils, 
a magnetic field is given within the set workspace, and assuming ideal coils, 
the individual magnetic fields giving the resultant magnetic flux density 
could be superimposed as in Eq. (7). 

The MiniMag is designed to restrict the locations of the electromagnetic 
coils to a single hemisphere (Schuerle et al., 2013), which is accomplished by 
moving the intersection point of the coils orientation axis. Less physical 
restriction is achieved in the workspace in addition to compatibility with 
an inverted microscope. The MiniMag’s reachable workspace is larger 
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(A) (B) 
Fig. 21 Schematic diagram showing the electromagnetic coils of the magnetic actua- 
tion system surrounding the workspace. (A) Isometric view, (B) top view (Ghanbari et al., 
2014), (C) MiniMag design configuration, and (D) MiniMag Magnetic workspaces 
(Schuerle et al., 2013). 


due to the smaller working distance, where the difference in workspaces 
configuration is due to the tilted geometry. 

Using the MiniMag TDE control configuration requires determining the 
desired error dynamics by selecting a natural frequency wn, and a damping 
ratio ¢, and according to Ghanbari et al. (2014), the gains were selected to 
K,= @,° and K, = 2€ w. The value of mo should be tuned according to 
the given implementation as it depends on the sampling frequency. As for 
Mo, One can start with a value close to or less than the nanorobot mass and vary 
the value based on the performance (Jin et al., 2008). The non-Newtonian 
fluid containing the robot is placed on the magnetic positioning system, 
where the position of the nanorobot was determined using the two cameras, 
one giving a top view and the other giving a side view. 

The TDE Minimag requires a high damping ratio to overcome the over- 
shoot of the step response (Ghanbari et al., 2014), which occurred for the 
dependence of the controller performance on the time delay. Increasing 
the sampling rate (by increasing the camera speed) will reduce the time 
delay, which results in less overshoot and faster controller response. In addi- 
tion, the inherent nonlinearities of the magnetic actuation were not included 
in the simulation. These nonlinearities associated with the unmodeled 
forces, including stiction at the initial position when the robot is in contact 
with the container surface, are sources of the overshoots observed in the 
experiment, which do not exist in the simulations (Ghanbari et al., 2014). 


Control by rotating field 
This method targets mainly swimming magnetic helical micro and 
nanorobots in non-Newtonian fluids. The swimmer dynamics view 
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applying an external force to the robot, as it reaches a steady-state movement 
instantaneously, where the drag forces Fy equal the external forces F,., 
(Peyer et al., 2014), as: 


Fix, + Fy =0 (18) 
In addition, drag torques Ty equal to external torques T,,.;, as: 
Text P Tu =0 (19) 


The drag forces and torques relates to the robot’s linear and rotational veloc- 
ity by the resistance matrix D, given by: 


Fy U 

sol z 
The translational velocity U and rotational velocity Q of the robot are given 
in Eq. (20), in relation to the magnetic torque that is applied externally. 
Magnetic forces are neglected, as the external magnetic field existing is uni- 
form. The gravitational forces are also neglected, as the movement due to 
the helical propulsion is the main physical interest (Mahoney et al., 
2011). The resistance matrix D can be calculated by using the resistive force 
theory (RFT), which is a method to capture the swimming behavior of 
micro and nano scaled subjects (Lauga et al., 2006). Consequently, the mag- 
netic torque T,,, applied to the swimmer is given by: 


T,=mxB (21) 


The magnetic property m is expressed as the magnetic dipole m = VM. 
Given that Bisa static field, the robot would align for Mand B to be collinear 
and remain stationary. To achieve a rotation of the robot, B is rotated at a 
constant speed: 


Bcos(q@t) 
B(@t) = | Bsin(@t) (22) 
0 


The magnetization M is constant for hard magnetic material M,, which 
describes the direction and magnitude of the magnetization. Soft-magnetic 
material magnetization M, can be expressed by a relation between the appar- 
ent susceptibility tensor y, and the external magnetic field H = B/o, where 
Ho is the permeability of free space (Abbott et al., 2007): 


M,=y,:R-H (23) 
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Fig. 22 Micro and nanorobots locomotion model using rotating field (Peyer et al., 2014). 


where R represents a rotational matrix transforming the external magnetic 
field into the local coordinate system in which M and y, are expressed. 

The robot locomotion model is shown in Fig. 22, where the robot’s 
motion is a function of the resistance matrix and the applied torque. The 
torque applied in the system depends on the magnetization of the robot, 
which is constant for hard-magnetic material or a function of the applied 
magnetics field in the case of a soft-magnetic material. In experimentations 
by Peyer et al. (2014), the continuous rotation of the helix around its axis 
results in a constant advancement forward along the helical axis. Depending 
on the angle between M and B, either a positive or a negative torque is 
exerted onto the robot, which causes the robot to switch between clockwise 
and counterclockwise rotation. 


Helmholtz One of the main devices for micro and nano swimmers’ posi- 
tioning using a rotating field is the Helmholtz coil, shown in Fig. 23, whose 


x-axis coil 
Microscope lens —= 


Micromanipulator 
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Tank 
z-axis Coil 
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Fig. 23 Helmholtz coils experimental setting. (From Zhang, L., Peyer, K.E., Nelson, B.J., 
2010. Artificial bacterial flagella for micromanipulation. Lab Chip 10 (17), 2203-2215, with 
permission.) 
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magnetic workspace is a union of the predicted magnetic workspace for all 
combinations of field and gradient orientations. It uses three pairs of orthog- 
onal electromagnetic coils to generate a uniform rotating magnetic field to 
actuate and control mostly ABFs (Zhang et al., 2010). The Helmholtz coils 
witness singularities when the field and force are not aligned, and thus it does 
not show the ability to exert force harmonically. A Helmholtz system can 
generate gradients using an unequal current input through the coils, if ori- 
ented along the same axis as the field. A singularity in the system is caused by 
using an orthogonal system to orient the device along the x-axis and move it 
along the y-axis. An ABF is rotated along its axis and self-propelled by apply- 
ing a torque emerging from a uniform rotating magnetic field acting on the 
ABF soft-magnetic metal head, which is given by Eq. (5). Motion direction 
can be switched by reversing the rotating direction of the magnetic field, 
which is much more straightforward and time-efficient than reversing 
motion by turning the swimmer 180°. The velocity depends on the rotation 
frequency, as shown in Fig. 24A, where the curves show that velocity 
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Fig. 24 (A) Dependence of ABF velocity on the size of the head versus frequency. (B) 
High actuation frequencies the wobbling decreases. (C) At low frequency, the preces- 
sion angle # is large (Peyer et al., 2014). ((A) From Zhang, L., Peyer, K.E., Nelson, B.J., 2010. 
Artificial bacterial flagella for micromanipulation. Lab Chip 10 (17), 2203-2215, with 
permission.) 
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increase if the frequency increases, and decrease as the available magnetic 
torque is no longer sufficient to keep the ABF motion (Zhang et al., 
2010). At low frequencies, the experimental results show that, although 
the ABF rotated in sync with the input field, it wobbled about its helical axis 
with a constant precession angle. The wobbling angle increases significantly 
at lower frequencies, as in Fig. 24C, so for precise steering, these effects must 
be taken into account, as they influence the propulsion direction of the 
swimmer (Peyer et al., 2014). 





5 Biomedical applications 


Nanorobotics shows a promising future in medicine and its applica- 
tions as its applications offer new types of tools in treatment and improvising 
human biological systems (Manjunath and Kishore, 2014; Azar and Ejjamel, 
2012). The potential starts from drug delivery to several targets inside human 
body by loading the drug dose to the drug delivery system (pharmacyte). 
Then, it can transport safely to the target and release the dose by 
nanoinjection or progressive cytopenetration. A second major use of 
nanorobots is body surveillance or continuous monitoring of vitals, this pro- 
vides a frequent response for a detected abnormal behavior. In addition, they 
are beneficial in dentistry as they can induce oral analgesia or manipulate tis- 
sues by aligning them in a desired form. Moreover, applications of 
nanorobots raise the success rate of delicate and difficult surgeries such as sur- 
geries of the retina and its surroundings. For instance, fetal surgery is con- 
sidered as one of the most risky surgeries due to high mortality rate of 
either the mother or the baby, but it will become much easier using 
nanorobots, as they will target the area desired with high precision and min- 
imal trauma (Bhat, 2014). Nanorobots provide gene therapy and artificial 
substitutes of human blood. In gene therapy, it gets allowable to compare 
the molecular structure of DNA and proteins found in cell and do a replace- 
ment for the found defective. On the other side of providing artificial blood 
substitutes, three different nanorobots are introduced. 


5.1 Surgical nanorobots 

5.1.1 Nanotechnology in surgical tool 

The recent advancements in nanotechnology have made it possible for it to 
be implemented in the most vital applications like surgery. Implementing 
nanotechnology in surgery introduces the concept of nanobiotechnology, 
which deals with injuries, curing diseases, and using the required tools to 
perform surgeries on the cellular level. The demand for less invasive 
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surgeries with less damage to healthy tissues has made it necessary for scien- 
tists to develop nanobiotechnology in an attempt to fulfill this need. Due to 
the fact that even the smallest scalpels are thousands of times the size of cell, 
performing an accurate operation within a single cell is impossible for sur- 
geons without the existence of nanoscaled tools. Furthermore, scientists are 
considering the ability of using this technology to enhance the abilities of 
human beings by applying DNA modifications, and new coronary arteries 
delivery. Applying this technology requires advanced and reliable diagnostic 
abilities in order to perform precise surgery and to provide effective treat- 
ment. This section will present different applications of nanorobots in sur- 
gery, treatment, and even diagnosis (Mali, 2013). 


5.1.2 Nanocoated blades 

As cutting blades are the main instrument in performing any surgery, intro- 
ducing new structures at the nanoscale for surgical blades contributes to 
developing more precise surgeries with less traumatic effects and less invasive 
wounds (Roszek et al., 2005). Coating the micro-structured metal with 
nanolayers of diamond is beneficial in the field of ophthalmic surgery and 
neurosurgery. The recent manufacturing technologies have enabled the 
production of cutting blades with diameters of 5 nm to 1 pm (Mali, 2013). 


5.1.3 Suture nanoneedles 

Forms of surgery currently being enhanced include plastic and ophthalmic 
surgeries, as they improve the appearance and the ability for better vision; 
improving those surgeries requires precise tools and minimal invasive oper- 
ations, which can be provided by using nanoneedles. These needles are made 
of stainless steel with a particle size of 1-10nm quasicrystals by applying the 
techniques of thermal ageing. Using silicon to prepare these needles 
improves their ductility, corrosion resistance, and strength. Taking into con- 
sideration that operating on the cellular level requires the least deformation 
of cells, as the minimal undesired mechanical reaction will interfere with the 
result of manipulation, the needles are manufactured at a size of 200-300 nm 
in diameter and 6-8 ptm in length. The continuous improvement of 
nanoneedles has made it possible to use them in the immobilization tech- 
niques of DNA, and chemicals or proteins loading. Nanoneedles also sup- 
port other surgery techniques on the cellular level that use stem cells to make 
differentiations that help to produce healthy and functional cells for dona- 
tions (Roszek et al., 2005). 
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5.2 Optical nanosurgery 

5.2.1 Optical tweezers 

Optical tweezers are also known as the optical trap, which is a powerful 
technology that is widely used in noninvasive manipulation for objects in 
the micro-scale. The technique is based on using light beams to control 
the motion and the formulation of particles. Once a continuous laser beam 
is directed on an object, repositioning of the object occurs due to steering 
and positioning of the light beam. The tweezers are made of CNTs attached 
to the electrode, which can bend, under specific force, to grab the desired 
molecule. This technology is precise and noninvasive as it enables the sur- 
geons to perform delicate operations on a single cell; the diameter of a 
nanotweezer is 50 nm and can be excited at 8.5 V (Mali, 2013; Roszek 
et al., 2005). 


5.2.2 Femtosecond laser neurosurgery 

A femtosecond laser can emit ultrashort optical pulses with a duration mea- 
sured in femtoseconds (1 femtosecond equals 10 '° seconds). Because of 
their ultrashort and ultralong pulses, ease in usage, and precision, femtosec- 
ond lasers are widely used in molecular structure manipulation and localiza- 
tion. They are also used in ophthalmic surgery to correct human vision. 
Using femtosecond near-infrared laser pulses with low energy helped to 
cut cell organelles without harming any surrounding tissues; this application 
is called “nanoscissors.” Based on the properties of the ultrashort pulses, they 
are capable of performing accurate operations on nerve cells and cut through 
nano-cell structures. Those operations are performed by heating the targeted 
area then cutting thorough it, but this can form a threat to the surrounding 
tissues, so nanoscissors provide the optimum solution for this problem. 


5.3 Nanocoated implant surfaces 


An implant is an artificial replacement for damaged body functional parts 
such as hip and knee joints, bone fracture treatment, and temporomandib- 
ular joints. An implant is usually made of titanium, polymers, or cement, 
which are biocompatible with the human body. The life of implants is 
affected by various factors such as poor growth on the surface of the implant. 
However, the life time for an implant can be enhanced by using materials 
that stimulate the formation of the fractured bones and by fixing the implant 
with an adjacent bone. The most preferable implants for joints are metallic, 
like stainless steel and cobalt chrome, due to their mechanical properties. On 
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the other hand, the high Young’s modulus for those metals may cause stress 
shielding, as they will not be as elastic as the surrounding living bones and 
joints. Seeking solutions for this challenge, scientists proved that the adsorp- 
tion of proteins that mediate specified osteoblast adhesion are improved on 
materials’ nanophase. The bioactivity of proteins is reformed on the 
nanophase materials based on their surface energetics, and the surface fea- 
tures that are close to the size of proteins (Roszek et al., 2005). Given the 
fact that the hydrophobicity or hydrophilicity of a surface can directly affect 
the behavior of cells and that the wettability of the material can contribute in 
categorizing this material with regards to hydrophobicity/hydrophilicity 
categories, implants or biomaterial composition with the presence of the 
required nanofeatures and immobilization of chemical agents can alter the 
wettability and enhance the behavior of cells on that surface. 


5.4 NPs for wound dressing 


Based on the antiinfective properties of silver, it has been beneficial for 
wound dressing by formulating bilayers of silver-coated polyethylene and 
an adsorptive core. It was demonstrated that using a coat of nanocrystalline 
silver on nonhealing wounds like burns and ulcers has sustained release that 
help keep antibacterial and fungicidal activity on the surface of those 
wounds. The silver nanoparticles start functioning by entering the wound 
through the body fluids, and then start to kill bacteria within 30 min. 
The wound surface can withstand the coating layer for several days, taking 
into consideration the amount of silver in the composite to avoid any toxic 
side effects. Wound care applications also benefit from the electrospinning 
technique that enables the production of polymer nanofibers. First-aid 
wound care products are developed based on creating a new delivery plat- 
form, which can be used as a powerful and efficient hemostatic agent in 
wound care. The spinning technique was developed by nanofiber technol- 
ogy companies to produce nonwoven materials for a wide range of biomed- 
ical, chemical, microelectronic, and industrial applications (Roszek 
et al., 2005). 


5.5 Tissue engineering 


Tissue engineering is the technology concerned with the replacement of the 
injured, damaged, or even missing tissues in the human body. The core three 
components to provide an alternative tissue are isolated cells, signal mole- 
cules, and extracellular matrix. The contribution of nanotechnology in 
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tissue engineering presents in providing wide range of options for the extra- 
cellular matrix, which is also known as the scaffold. This scaffold is primarily 
contributing in three roles, which are, promoting the localization process of 
cells in the human body, supporting the regeneration process of new well- 
structured tissues, and provide the required guidance for this regeneration. 
The interaction between the cells and the extracellular matrix has a direct 
effect on the function of the new generated tissues, so the process of con- 
trolling the porosity of the suggested nanomaterials is crucial to obtain 
the required properties. Additionally, controlling the mechanical character- 
istics can help generate well-functioning tissue-engineered products (TEPs). 
The role of nanotechnology presents itself by providing the most successful 
candidates for TEPs application. The first candidate is nanofiber-structured 
tissue, which is prepared using the electrospinning technique. Applying this 
technique, knowing the physical properties for nanofiber matrices such as 
the interconnective pores, high porosity, and high surface area make this 
candidate perfect for developing the scaffold of TEPs. The second option 
is CNT, with its ability to guide the live biological cells and the ability of 
forming neural networks in vitro that play a great role in the repair and 
regeneration processes of the central nervous system. Those processes are 
essential for brain or spinal cord injuries. (Mali, 2013, Roszek et al., 2005) 


5.6 Nanorobots for cellular-level surgery 


Digging through the field of nanotechnology, the AFM has proven to be the 
best instrument to study the nanoworld. AFM is a tool that enables imaging 
of living samples and measuring a variety of mechanical properties. An 
AFM-based nanorobot is a powerful candidate for the critical need of oper- 
ating on living cells. As the AFM has a tip that is approximately 20 nm or less, 
which can operate on living-cells samples, an AFM-based nanorobot can use 
this tip as an end effector that will conduct precise operations. Given the 
several advantages of AFM technology, such as high-resolution imaging 
and vacuum-free working environment, developing AFM-based 
nanorobots will be capable of generating images on nanoscale, providing 
accurate measures of mechanical properties, manipulating samples on nano- 
scale, and conducting accurate operations on living cells, due to the precise 
motion control of the nanorobot. Due to the complexity of cellular-level 
surgeries, and the need for real-time monitoring to guarantee precise oper- 
ation, three techniques were developed to overcome these challenges. (Song 
et al., 2012) 
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The three developed techniques present the operating principles of 
AFM-based manipulators. First, the interface developed by augmented real- 
ity systems enables the operator to control the position of the nanorobot 
using a joystick. Second, the end effector of the nanorobot can be equipped 
with specialized tips to perform various types of surgeries and drug delivery 
operations. Finally, the whole operation should be monitored using real- 
time system as a feedback to insure the accuracy of the operation. This online 
monitoring is critical to update the operator with the most recent images of 
the currently running operation by taking discrete images of the current 
position of the nanorobot or by producing continuous imaging for the full 
work surface. Increasing the rate of real-time monitoring 1s beneficial for the 
accuracy of the operations, so the scientists developed two methodologies to 
achieve this goal. The first is online sensing, which enables generation ofaccu- 
rate calculations of the force exerted on the tip of AFM due to the cutting 
pressure and depth. The other methodology is developing an adaptive scan 
for the area under operation that will generate more reliable real-time topog- 
raphy. The following sections will discuss the three main techniques of the 
working principle of AFM-based manipulators (Song et al., 2012). 


5.6.1 Augmented reality system 

The augmented reality system is designed to provide an active interface that 
shows the user or the operator the actual position and motion of the AMF 
tip. The joystick is used to control the directions of the nanorobot along 
with providing it with three-dimensional (3-D) forces. Along with control- 
ling the motion, an augmented reality system in AMF provides updated 
images with the high quality and high frame rate (video rate), which keep 
the user updated with the real-time position of the nanorobot. In spite of the 
continuous development in position control of the nanorobots, two factors 
cause critical errors regarding position control. The first factor is the thermal 
drift, which is the drift in actuator outputs caused by temperature change. 
Controlling the environment surrounding the manipulator will result in sta- 
ble thermal drift, which will indicate the accurate position of the tip. The 
thermal drift can be controlled by using local scan mechanisms that detect 
the initial position of the tip before starting the operation and then calculate 
the effect of thermal drift, which will make it easy to predict the error caused 
by this factor. The second factor is the cantilever bending, which can cause a 
sideways displacement along the cantilever length. The effect of this factor 
can be avoided by controlling the stiffness of the probe, and the position 
algorithm (Song et al., 2012). 
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5.6.2 Local drug delivery 

The AFM tip can be used in local drug delivery by attaching antibodies or 
ligands to it. This application can enhance the researches concerned with the 
effects of those chemicals in vitro local drug delivery. There are two main 
methods for loading a functionalize AMF tip with specific chemicals. The 
directly used method is dipping the cantilever or the tip in the specified 
chemical solution. The widely known method is to use a linker molecule 
between the AMF tip and the targeted molecule, which will increase accu- 
rate targeting in 3-D. The principle of this method is based on creating a 
covalent bond between the chemical and the linker molecule (Song 
etal. 2012). 


5.6.3 Online monitoring for nanosurgery 

As discussed before, the monitoring system is responsible for providing real- 
time video of the position of the operating nanorobot. The online monitor- 
ing process has several steps that presents the functioning technique. The first 
step is to calculate the required force on the AMF tip to cut through the 
targeted surface. Determining if the tip has cut through the sample surface 
or not is considered as the critical step to start the tip motion planner. Once 
the tip goes through the surface and the motion planner starts working, the 
visual feedback is generated and sent to the operator to detect the current 
position of the nanorobot. The motion planner also performs accurate scans 
that generate precise directions and ranges of the cutting tip. The initial scan 
range is quarter of the original real image size, and it can be customized to fit 
several nano surgeries. 

Another important term in online monitoring is compressive scan tech- 
nology, which is a fast imaging strategy that samples fewer data and then gen- 
erates a new reconstructed image. This technique enhances the capturing 
rate of the changes occurring during the nanosurgery, which results in more 
precise and accurate operation. The compressed sensing can be controlled 
through the motion planner, which controls the exact location and time 
of the new compressive scan. After capturing and updating the required 
images, the video is then displayed on the online monitoring system to guide 
the operator or the user (Song et al., 2012). 


5.7 Cancerous tumor killing using nanorobots 

The first type of nonrobots that simulate red blood cells in the functionality 
of oxygen and carbon dioxide exchange are respirocytes. They are typical 
spheres of 1 pm diameter and constructed of 18 billion atoms arranged in 
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diamondoid pressure tanks. These cells can store about 3 billion oxygen 
molecules and deliver at a rate 236 times higher than natural red blood cells. 
They include three rotor types for storing oxygen while travelling, capturing 
carbon dioxide from the blood stream and releasing at the lungs, and taking 
in glucose from blood as a fuel source (Freitas, 1998; Arpita et al., 2013). 

Second type of nanorobots simulating blood are microbivores, also 
known as nanorobotic phagocytes. They are made up of diamond and sap- 
phire with a measurement of 3.4 tm in diameter along the major axis and 2.0 
fim diameter along the minor axis. It mainly contains 610 billion structural 
atoms that are arranged in a perfect form. Microbivore aims mainly to per- 
form phagocytosis process. They consist of four fundamental components: 
an array of reversible binding sites, an array of telescoping grapples, a mor- 
cellation chamber, and a digestion chamber to do the whole digestion cycle. 
These robots are completely safe in removal as they exit the body through 
the kidneys and are then excreted in urine (Bhat, 2014). 

The last type of nanorobots that simulates a part of human blood are 
clottocytes. The main function of clottocytes is doing the hemostasis pro- 
cess, the process of blood clotting by platelets once damage to the endothe- 
lium cells of blood vessels is detected. Nanotechnology shows an impressing 
success in this field, as it reduces clotting time to be 100,000 times faster than 
the natural hemostatic system. Furthermore, it avoids the use of drugs with 
side effects trying to treat the irregularity in the hemostasis process in some 
bodies. These drugs were creating bad side effects such as hormonal secre- 
tion that could damage lungs and allergic reactions (Boonrong and 
Kaewkamnerdpong, 2011). Clottocytes are 2 fm in diameter, powered 
by serum-oxyglucose, and contain fiber mesh folded onboard; this mesh 
can be biodegradable. Although clottocytes show a huge benefit, there is 
a major risk of the mechanical platelets triggering the disseminated intravas- 
cular coagulation due to their extra-activity. This may result in multiple 
micro thrombi (Eshaghian-Wilner, 2009). 

In fact, the motivation behind the great development of nanorobots and 
related technologies was the desire of finding the optimal solution for cancer 
treatment. Cancer can be presented as a group of diseases that grow rapidly in 
an uncontrollable way, causing tumors. Now, it can be treated by combining 
the current knowledge and medication with the technology of nanorobots 
and its advanced DDS. These systems are beneficial as they can perform 
diagnosis and treatment of cancer by carrying large amounts of a drug to 
tumors while decreasing side effects of chemotherapy (da Silva Luz et al., 
2016). Nanorobots as drug carriers for dosages allow maintaining the 
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chemical compounds for a longer time, as necessary, into the bloodstream 
circulation. Fuzzy control is applied to identify and treat cancerous tumors 
in patients’ bodies. The process starts by detecting the exact position of 
tumors or defective cells getting benefit of its magnetic property. Defective 
cells identification is performed based on a given data set to the controlled 
and built-in membership functions; it depends mainly on the shape and tem- 
perature of the cell in comparison to normal conditions. Then, the stage of 
cancer cell is determined according to gathered information about size and 
shape of nucleus and cytoplasm. Lastly, the drug carried by the nanorobot is 
delivered exactly to the diseased cells, which is beneficial in two ways: it 
avoids drug wastage by delivering the entire amount to the tumor, and pro- 
hibits the drug from interacting with surrounding healthy cells, avoiding side 
effects of chemotherapy (da Silva Luz et al. 2016; Karan and 
Majumder, 2011). 

Another way is to use magnetic nanocatalysts in cancer therapy. A 
research proposed by scientists discusses how it is efficient to use magnetic 
nanorobots to activate chemotherapeutic prodrugs in the treatment process. 
In fact, it has been shown that the only approach to use anticancer drugs is 
transforming chemotherapeutic agents into latent prodrugs; this is only 
effective upon catalytic activation. Prodrugs are divided into two sections. 
The first group relies mainly on the metabolic activation via enzymes, which 
requires insertion of foreign enzymes to the human body. Consequently, it 
develops an error of hitting the targeted tumor or diseasing surrounding 
healthy cells. The second class are called biorthogonal prodrugs; these are 
more physiologically stable precures as they can get activated through bio- 
compatible heterogeneous catalysts by means of biorthogonal organometal- 
lic reactions. Despite focusing on transiting metals to catalysts, part of these 
transitions causes toxic side effects. Palladium was the best choice as it 
exhibits strong catalytic activity. 

A nanowire was previously proposed as a composition of magnetic iron 
(Fe) and palladium (Pd), which is a very well-known biorthogonal catalyst. 
This composition, added with Pro-5-FU, led to reduced viability of cells. 
The magnetic field property of cells attracts the nanorobots to the area of 
disease, which demonstrates a high ability of hitting the target. This research 
was proved by injecting the proposed nanowire into cancer tumor xeno- 
grafts. This resulted in retarding the tumor without causing any significant 
side effects (Hoop et al., 2018). 
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5.8 Laparoscopic cancer surgery using nanorobots 


Nanorobots not only have a promising future in medicine, they are also ben- 
eficial for the field of surgery. In specific, nanorobots have an important role 
in laparoscopic cancer surgery. This implies the concept of integration 
between surgical teleoperations and nanorobotics contribution in the med- 
ical field. Although cancer can be treated using the current medicines and 
technologies of tumor elimination, it has crucial factors that determine 
the survival period of cancer patients. For example, both the precision of 
the surgeon in eliminating diseased cells and the growth behavior of the can- 
cer give an indication about treatment success. Avoiding human error in 
such surgeries, different methods are being used, although their results are 
disappointing. Although clearer, magnetic resonance imaging (MRI) was 
limited in specificity and sensitivity. Retroperitoneal lymph node dissection 
(RPLND) showed an acceptable result as it is directly related with determin- 
ing areas associated with tumor cell invasion. Accordingly, nanorobots are 
inserted to gather reliable information about targeted area, forming a map 
to deal with the medical procedure in a precise and professional way. In gen- 
eral, laparoscopic systems can depend on different tools, such as sound, to 
control steps of robotic arm motion with an aim of improvising smooth 
behavior. 

The DaVinci is the most advanced master-slave system developed so far, 
and is responsible for a huge number of delicate surgeries (Guillou et al., 
2005). This system has seven DOF, while normal laparoscopic instruments 
allow only four DOF. The DaVinci consists of three main components: 
(a) A surgeon console, which is responsible for controlling the movement 

of the arm although being placed away. It considers motion scaling to 
eliminate tremor and get very precise motion steps. 

(b) Patient-side cart has the arm mounted on it to provide the three- 
dimensional view desired in the progress. 

(c) Image insufflation stack, which has the camera-control units allowing 
vision for surgery assistants and carrying the rest of the units such as 
image-recording devices, laparoscopic insufflator, and monitor. 

(d) Nanorobots, which is the new part added to the DaVinci system to pro- 
vide it with an accurate mapping of the area required to be treated or 
eliminated without harmful side effects; it uses high precision trans- 
ducers in allocating these areas in the real time domain. 
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Nanorobots’ use in medical treatment and surgery may be enhanced in a way 
that it demarks areas that are more likely to be infected or get a new growing 
tumor (Guillou et al., 2005). 

Nanorobots also push the boundaries of treating oral cancer. It requires a 
prestep using saliva diagnostic medium and different highlighters to define 
the infected cells, then nanoshells, which are miniscule beads that are specific 
tools in cancer therapeutics, take the responsibility of destroying infected 
cells. Another method, which is under experimental testing, is 
nanoparticle-coated. This method uses radioactive resources to destroy 
the tumor by being placed near to or even inside it. Although it seemed like 
an impossible mission in the past, it has reached the phase of experiment test- 
ing relying on the conceptual idea of nanorobots that swim in vivo. 


5.9 Cell cutting using nanorobots 


One medical application of nanorobots that concerns many researchers is 
cell manipulation in vivo. This manipulation can be represented by many 
operations such as cell cutting, cell treatment, cell DNA accessing and 
manipulation, and drug delivery. All of these areas of research have been 
given great interest over years. Being one of the promising fields with a 
lot of usage in surgeries and diseases treatment, cell cutting using nanorobots 
has been analyzed multiple times by researchers over the years. 

In a work done by Shen et al. (2010), the nanorobotics system was rep- 
resented by a nanoknife that was designed and manufactured to perform cut- 
ting of a single cell. Making advancement to the technology used at that 
time, the researchers were capable of fabricating a nanoknife with an edge 
angle of 5°. Not only advances to the design were proposed, but changes in 
the materials were also introduced in that research. The use of CNTs in the 
operation of cell cutting came as a replacement to the conventional tech- 
nique of using glass and diamond. Fabrication was done by welding using 
FIB etching technique and AFM. 

Moving a step forward to the control of the designed cutting 
nanoknife, environmental scanning electron microscopy was used as the 
equipment for manipulation, taking advantage of its capability to allow live 
tracking of biological systems in high humidity. This manipulation, along 
with theoretical and numerical analysis, was used to calibrate the knife for 
doing its cutting task. The cutting force used in performing the cell cutting 
by the Nano knife was calculated based on the deformation in the shape of 
the nanoknife. 
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(B) 
Fig. 25 The model of the nanorobot system for single cell cutting using conventional 
robotics kinematics. (From Shang, W., Lu, H., Wan, W., Fukuda, T., Shen, Y., 2016. Vision- 
based nano robotic system for high-throughput non-embedded cell cutting. Sci. Rep. 6, 
22534, under the Creative Commons license.) 


In research done by Shang et al. (2016), another successful proposal for 
the use of nanorobots in cell cutting was made. What distinguishes this pro- 
posal is the development ofan automatic system that works exactly like other 
familiar robots in measuring the distance between the knife and the target 
cell, using homogenous transformations as well as calibration for ensuring 
the results to guide the automatic manipulator to perform its cutting task, 
as shown in Fig. 25. Again, environmental scanning electron microscopy 
was used due to its features in observing the operation and controlling of 
the nanorobot in different stages. Success of this fabrication and manipula- 
tion proposal was shown by the ability of the nanorobot to cut within 
1—2 min. It becomes superior to the use of AFM, which is able to perform 
cutting in the normal conditions of the cell, in the capability to cut a single 
cell, which is not possible with AFM. Additionally, the shape edge and accu- 
racy of cutting has a great effect in reducing cell compression during the 
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cutting operation and preventing cell damage after being cut. The analysis of 
this proposal was done using yeast cells, which are very similar to human cells 
and are already used by many other researchers to study genetics. The cell 
was cut into two pieces with cutting force of 30.3 HN. 

These advances in the applications of nanorobots open the door for more 
interest to be given to that emerging and promising field to be more capable 
for application in real life operations. In fact, there is an obvious defect 
between the successful results of research and the implementation in real life. 
This was obvious by recognizing that although a proposal for a nanoknife 
was made in 2010 by Shen et al. (2010), the same conventional methods 
of cell cutting—which all have limitations in single cell cutting in normal 
cell conditions—were still used in 2016 at the time of the new nanonknife 
proposal by Shang et al. (2016). 


5.10 Bacteria propelled nanorobots 


When nanorobots’ usage in medical applications was suggested, many pro- 
posals for the method of propulsion inside the body were made. One of the 
most suitable, widely researched, and promising methods of propulsion 1s 
the propulsion by bacteria or flagella. This method represents a good inte- 
gration between the fabricated artificial parts of the nanorobot along with 
biological systems in order to perform a certain task. Advances in research 
about propulsion is of great importance, because it is essential for all 
nanorobots in medical application, no matter what task the nanorobot will 
perform or what kind of disease the nanorobot contributes in treating. This 
generality has caused this research area to attract the attention of researchers 
over the years. Additionally, the interest in bacteria propulsion stems and 
rises from the scientists’ trials to reduce the power sources for on-board 
nanorobotic bodies for minimization of robot size to fit inside small blood 
vessels. The smaller the body of the robot, the more flexibility in doing med- 
ical operations, and the more potential to use a swarm of many nanorobots 
communicating together to achieve a task. 

In a research done by Martel (2008), a nanorobot propelled by the two- 
diameter MC-1 magnetotactic bacterium was proposed. In order to control 
these nanorobots, magnetosomes embedded in the propelling bacteria were 
the means of propulsion. Magnetosomes are structures present in the mem- 
brane of the bacteria, and they contain magnetic particles rich in iron. By 
knowing their structure, control and manipulation of them is used to affect 
the movement of bacteria. In other words, torque induction was applied 
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over the magnetosomes to control the direction of bacterial propulsion, and 
thus of the driven nanorobot. Scientifically speaking, microelectronic cir- 
cuits were used to deliver current to generate the necessary torque on the 
magnetic particles. The achievements of this driving mechanism using 
magnetotactic bacterium in this proposal were a speed of 300 m/s of the 
motion for unloaded bacteria and a thrust force of 4 pN per bacteria. These 
experimental results are promising, since they can be of great suitability to 
propel a medical nanorobot inside the human body to either detect or inves- 
tigate cellular functions or treat a disease. This proposed technique can be 
used in other applications, such as nanoactuators or nanosensors. The depen- 
dence on bacteria provides a good platform for many applications regarding 
medical fields, and it makes propulsion easier than designing some artificial 
bio-friendly devices to perform this driving task. 

In a work done by Martel et al. (2009), the use of magnetotactic bacte- 
rium in nanorobotics propulsion is proposed again, with advances in the 
research. The core of this research was the desire to enable the nanorobot 
to go through the smallest capillaries. An external—not on-board— 
controller for the motion of the nanorobot was used to control the swarm 
of bacteria for propulsion through controlled magnetic field intensity. The 
gap which this research points out was the fact that previous literature con- 
trolled the bacteria motion precisely in terms of controlling when the 
motion will start and when it will end, with low control over the directional 
movement of the bacteria-propelled nanorobot body. In this research, a 
mathematical equation for finding the terminal velocity of the bacteria 
was proposed. Analysis for the relation between the terminal velocity and 
the body temperature was carried out to prove that higher body temperature 
affects the velocity negatively by decreasing it as a result of changes in the 
viscosity of the blood. As a part of propulsion system designing, the loading 
method for the bacteria was studied in this research. Four loading methods 
were discussed, as shown in Fig. 26. The loading method done by attaching 
nanoparticles to the cell is one of the manners with the high promising 
potential to be used in many medical applications. 

Not only the body temperature affects the propulsion speed of the Nano 
robot, but also the drag force induced by the small-sized diameter of the cap- 
illary in which the motion will take place. More importantly, the loading 
method of the nanorobot or NPs will further affect the drag force and 
the speed. Here is the area where all design parameters interconnect and 
affect each other. DC magnetic field was used to control the motion of 
the bacteria, while a proposal for the use of chemical agents was also 
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Fig. 26 Loading methods for bacteria propelling nanorobots: (A) The deliverables are 
loaded inside the cell of bacteria. (B) The deliverable nanoparticles are loaded by 
attaching them to the cell. (C) The nano or micro body is pushed by the means of bac- 
teria. (D) A large body was propelled by a swarm of bacteria. (From Martel, S,, 
Mohammadi, M., Felfoul, O., Lu, Z., Pouponneau, P., 2009. Flagellated magnetotactic bacteria 
as controlled MRl-trackable propulsion and steering systems for medical nanorobots operat- 
ing in the human microvasculature. Int. J. Robot. Res. 28 (4), 571-582, with permission.) 


proposed within the research. This proposal was accompanied by two lim- 
itations. The first one is the potential effect of this agent on the place where it 
is used—which is in vivo. The second limitation is the fact that chemical 
agents cannot be controlled through the electronic circuits. In a nutshell, 
manipulating the nanorobot movement through the bacteria by the use 
of chemical agents will not give us full control over the movement. Further- 
more, researchers have investigated the possibility of nanorobot propulsion 
using artificial flagella. This technique of bio-mimicking stems from the idea 
of using bacteria as the propulsion driver while using artificial parts in order 
to have a higher control, and to alow usage in a wider field of applications. 


5.11 Heart surgery using nano robots 


Heart disease, heart attacks, and heart transplant are all important areas that 
concern many people because of the criticality of having a serious problem 
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with the heart. The application of nanorobots in solving heart problems is 
one of the promising fields that carry hope to many people, and thus it is 
tackled by many researches from different points of view. These points of 
view range from using nanorobots in regular health checks to detect prob- 
lems at an early stage, to the use of nanorobots in heart surgery, to even the 
use of them for after surgery care while they are maintained in vivo. 

Ina work done by Cavalcanti et al. (2006), nanorobots were proposed to 
be used in stenosed coronary occlusion (SCO) treatment. SCO is the med- 
ical case of obstruction of blood flow to the coronary artery, which results in 
heart attack. Chemical and thermal treatment will be provided by the means 
of nanorobots. Accordingly, the components of the Nano robot are sensing 
elements—temperature and chemical sensors, energy supply and actuator. 
Although real fabrication is not done in this research, simulation is done 
using the clinical data and biological information to ensure the possibility 
of fabricating this nanorobot and manipulating it. In addition, valuable data 
about blood velocity, blood streamlines, and blood temperature are dis- 
cussed, as they are the key design inputs in the process of manufacturing 
a nanorobot that will go through the blood stream—especially, if it is 
planned to manipulate heart issues. 

In another work, carried out by Merina (2010), a novel proposal was 
made for using nanorobots for after surgery care in heart transplant cases. 
From a medical point of view, although heart transplant surgery itself is use- 
ful in helping patients with heart failure to survive, a major problem of cell 
rejection to the new heart is common among patients; with at least 40% of 
heart transplant survivors having at least one rejection case during the first 
year after the transplant surgery. In many cases, symptoms of this rejection 
do not appear in the patient for a long time. In this research, the design of a 
nanorobot to help in detecting and controlling the presence of infection or 
heart rejection is developed. Although no trial for fabricating the nanorobot 
was done in this work, framework and design elements ranging from main 
components to materials are discussed. Additionally, for fabricating the 
Nano robots, self-assembly and external-assembly were proposed. The for- 
mer is done by letting the robot assemble itself from cells and components, 
while the latter is a human-made assembling operation. 

In research conducted by Wamala et al. (2017), nano soft deformable 
robots have been proposed for usage in surgery as automated surgical tools. 
The main focus of this work was the novel use of soft robots, which are nec- 
essary and have preference over other rigid robots in surgeries related to the 
heart. The reason behind this is the fact that these robots will not damage 
tissues while doing their task or while moving inside the blood vessels. Their 


384 Ahmad Taher Azar et al. 





ease of deformation and their fabrication from bio-friendly materials makes 
their motion more flexible with fewer obstacles. Furthermore, this proposed 
soft robot will depend on its control over biological systems and physical 
properties, instead of many external circuits and motors. This adjustment 
to the design from other conventional designs of nanorobots is perfect to 
suit the application in which the nanorobot will be used. 

The challenge that still impedes the implementation of such nanorobot 
designs in real life and in performing real surgeries is the precise propulsion. 
A combination between this design for soft robots with the bacteria propul- 
sion system proposed by Martel et al. (2009) will probably build the link 
between the proposals and the implementations. Experiments on models 
as well as simulations should be conducted to ensure that the interference 
of the nanorobot with the heart is well and healthy for the functionality 
of the heart. 

Technological advances are what distinguish earlier efforts on the topic 
of using nanorobots as a treatment for cardiac issues from efforts made by 
researchers nowadays. Access to laboratories with higher technologies and 
equipment to help in fabricating and testing the proposed nanorobot is shap- 
ing the future of research and implementation in this area. Precision and 
accuracy are of great importance in this specific application due to the crit- 
icality associated with operating or performing surgery related to the heart. 





6 Discussion 


Regarding the medical field, nanorobots present impressive solutions 
and enhancements for problems, diseases, and even systems. However, the 
review conducted about nanorobots components and their existing designs, 
fabrication methods, and motion scientific bases was limited by the currently 
available technology. In other words, most of the discussed designs and their 
fabrication depend mainly on the magnetic field in their motion, whether it 
is gradual, rotary, or even reciprocal. One of the limitations that faces the 
upgrade done by nanorobots is providing a suitable powering source for 
the designed system. Actually, researches have tried, in a theoretical way, 
to provide a solution by presenting an artificial molecular pump (Cheng 
et al., 2015). This pump can perform its function by transportation of small 
positively charged rings from a bulk solution, considered as an initial envi- 
ronment, to high-energy multicomponent assembly representing the new 
environment. The pump functions against local concentration gradient so 
as to form potential energy. Additionally, the design underneath represented 
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a mechanism that choreographs relative molecular forces, controlling the 
noncovalent forces in a very precise way (Cheng et al., 2015). If this mech- 
anism goes the way of proof of concept and applicability testing, it can adda 
new solid layer of applications to be added to benefits of nanorobots in the 
medical field. 

One of the promising actuation methods for nanorobots is piezoelectric- 
ity, which is a physical property that is widely known; it is the polarization 
experienced by a material when being subjected to mechanical stress. It has 
been encountered in research many times for being used in electric power 
generation. In the framework of medical nanorobots, piezoelectricity forms 
a method of actuation for nanomanipulators. Researches done by Sinha et al. 
(2009) and Li et al. (2016) discussed the use of piezoelectric properties of 
materials for two-dimensional drive for nanoactuators. The results of both 
researches have shown that the former had reached the speed of 0.3 mm/s, 
while the latter had reached vertical deflection of 40 nm under actuation by 
2 V. the drawback in the latter research is that the layer thickness, which was 
fabricated from aluminum nitride, is 100 nm; this thickness represents a 
challenge when trying to make a complete nanorobot within the nanoscale 
(Liet al., 2016). Additionally, considering power for a nanorobot that targets 
in vivo missions is still a challenge. 

Research and advances in electronic engineering have been directed 
towards minimizing the size of passive components, such as capacitors 
and inductors, in order to fit into nanoelectronic chips. Apart from fabricat- 
ing small components and mounting them on the surfaces on electronic 
chips, including these components in substrate of chip in embedded form 
improves the size target as well as the functionality of components (Khan 
et al., 2018). 

Continuing with the challenges, the conventional classical laws of circuit 
theory cannot be applied anymore due to tunneling phenomenon that 
occurs in such a scale, and their behaviors are better described by quantum 
theory. With shifting the concentration from classical theory to the quantum 
one, designs for single electron transistors (SETs) as well as resonant tunnel- 
ing diodes (RTDs) are proposed, which show how electric components that 
are used in everyday life, such as transistors and diodes, can work under new 
concepts and governing rules (Forshaw et al., 2004). 

The CMOS process is considered an ideal technology to create pH- 
sensitive arrays due to their significant scalability and low-power opera- 
tion. This unmodified ISFET type is created using an extended metal gate 
that comes with a sensing membrane above; it allows the CMOS to use this 
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layer as a pH sensor. The detection of this type is based on using the sensing 
membrane as a double layer of SiO02-Si3N4 (Rasooly and Herold, 2009). 
The structure of the floating-gate FET (FGFET) consists of two main 
gates: sensing and control. Those two gates are joined in a capacitive man- 
ner to a common floating gate; therefore, any change in the potential in 
either of them adjusts the potential of the floating gate. In fact, this type 
is widely used in DNA charge molecule detection as the principle based 
on the assumed charge generated by DNA molecules (Rasooly and 
Herold, 2009). 

The extended-gate FET (EGFET) is a simple combination of the merits 
of both ISFETs and the coated-wire technology. This type is distinguished 
by the possibility to separate between the dry and wet environments. The 
working principle of the EGFET is that the sensor generates the signal phys- 
ically from high to low impedance environments. The EGFET simple struc- 
ture is used in specific sensing cases such as a pH sensing, and BHV-1 
antibodies detection based on sensing the electrical enzyme-linked immu- 
nosorbent assay. The specific structure for such type is also useful in sensing 
extracellular K+ concentration with pad fabricated on the micro-scale 
(Rasooly and Herold, 2009). The dual-gate sensor (DGFET) shares a similar 
structure to the FGFET sensor. The dual-gate type is widely used in pH 
sensing and it can be used with minor scale of DNA detection. The structure 
of this type implements additional gates that affect the sensor response pos- 
itively (Rasooly and Herold, 2009). 

Regarding future technology for nanorobots, a general optimism should 
be spread as there is a good solid ground to build on. Despite the huge risk 
taken in each step, introducing the internet of nano things (IoNT) to the 
nanorobots world will cover a good portion of tedious tasks and applications. 
Nevertheless, additional researches conduction and development is a must. 
IoNT helps in having a complete view of the internet of everything (IoE) 
when it provides the incorporation of nanosensors in diverse object by the 
help of nanonetworks (Miraz et al., 2018). It is concerned with the connec- 
tion between the four pillars of people, process, data, and things, instead of 
giving all concern only to “things.” Actually, the ability of practical imple- 
mentation of IoNT has been proved theoretically when transceivers 
succeeded in being implemented using Tetrahertz frequencies. Accordingly, 
the future work should focus on developing the interface between IoNT 
and actually existing micro and nano devices. It can be even taken from dif- 
ferent perspectives of industry and the medical arena. Moreover, standard- 
ized software and protocols of work can be achieved by the agreement of 
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institutions developing such researches to implement the concepts of loNT. 
The software to be used should be designed on optimal architecture criteria. 
Main requirements of implementation of IoT, such as power requirements 
and energy-aware routing, should be considered. 

Regardless the focus on control and electronic solution growth, it is a 
wonderful idea to consider material engineering and science in nanorobot 
material selection procedures. This field can get benefit from the rise of 
material biodegradability concepts to avoid taking additional steps. For 
instance, using biodegradable material in manufacturing nanorobots may 
help save drugs inside the robot for a specific time period until the material 
is completely dissolved, or it may help in getting rid of the nanorobot after 
completing its mission without the need of surgery to eliminate it from the 
human body. Therefore, material scientists should give some concern to try- 
ing to help in this particular area, helping in the great impact of nanorobots. 





7 Conclusion 


The scientific revolution allows the merging of different fields of 
information technology, biotechnology, medicine, and robotics. This inte- 
gration helps greatly in different fields, i.e., the medical field has reached an 
impressive phase whereby manufacturing of robots in the nanoscale starts to 
provide significant support in disease identification, drug-delivery, and even 
treatment. Previously conducted researches, from 2008 to 2018, reached 
solid steps in the field with highlighted discoveries. Field previous achieve- 
ments are summarized in the proposal done to use flagellated magnetotactic 
bacteria in the control and tracking subfield of nanorobots, another to detect 
diseases relying on the scientific base of PSO algorithm, and a proposal to use 
nanorobots in several applications such as heart transplant or DDS. Modeling 
and simulations have been done to validate the efficiency of using flagella 
propulsion in hybrid nanorobots. Another is done for nanorobots that repair 
damaged blood cells. These achievements were continued by researches dis- 
cussing the fabrication of nanorobots based on several perspectives in 2014 
and 2015. Researches in 2018 tried to validate if manufacturing nanorobots 
for discussed benefits is worthy or not. 

Robot main components like actuators, sensors, electronic ships, and 
controllers are presented as discussed in different previous researches to suit 
several aims of manufacturing a nanorobot. Moreover, discussed in brief are 
the designs that have already been applied in the real world and shows a suc- 
cess in motion in vivo such as flagellum bacteria, delivering drug to 
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cancerous tumor, or even taking a sample from an infected cell to be tested 
and analyzed outside the body. These collections of designs open the door 
for imagination of specific integration between designs and components 
producing a nanorobot that is responsible for a specific target. 

Several applications are discussed as a proof of the assistance of 
nanorobots in the medical field. These applications cover different areas 
starting from detecting diseases by noticing the generation of specific 
enzymes around the infected area or in blood, passing by drug delivery, 
including different diseases such as diabetes or even cancer, and reaching sur- 
gical targets of nanorobots in tumor elimination without harming the sur- 
rounding area. Nanorobots also help traditional ways of tumor detection, 
treatment, or elimination by giving full data/map to the area to be handled 
and give help in monitoring human body behavior in normal conditions as a 
check-up for being healthy. In a nonstoppable way, nanorobots show an 
impressing functionality of simulating blood components and providing 
artificial blood that helps in treatment of several diseases resulting from short- 
age of one of the blood components. 

Looking forward to new discoveries and enhancements regarding 
nanorobots, the integration with the internet of nano things to control 
the nanorobot from outside the body would be a great addition to the con- 
tinuous success of nanorobots and a new level of integration between tech- 
nology, intelligence, and control. Furthermore, use of biodegradable 
materials in manufacturing of nanorobots gives an advantage of forming eas- 
ily destroyed components that cause no harm or side effects in the human 
body. In addition, it saves cost and eliminates the risk of components’ elim- 
ination by surgery or any other way. 
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1 Introduction 


Rehabilitation is a treatment process performed to increase the quality 
of life of an individual with physical disability, which might be congenital or 
happen due to an accident, aging, or an illness and to reach the optimum 
functional level (inal, 2000; Akdemir and Akkus, 2006). In parallel with 
the increase in the world population, the need for rehabilitation is increas- 
ing. Various medical methods have been developed to treat limb injuries as 
much as possible. Accordingly, therapeutic exercises have a crucial role in 
physical medicine and rehabilitation area. They include specific exercise 
movements that are performed by a physiotherapist for the target limb. 
The purpose of these exercises is to regain range of motion (ROM) and 
rebuild muscle strength, endurance, elasticity of tissues, and patient’s motor 
skills. The physiotherapist performs therapeutic exercises either manually or 
by various exercise devices. Scientists have done many studies on rehabili- 
tation robots by stating that performing these exercises with robotic systems 
will provide many advantages and convenience both for patients and phys- 
iotherapists. These studies have gained momentum in the last 15 years. Some 
of these studies have been turned into commercial products (Sobh and 
Xiong, 2012). The functional recovery is a long and laborious process 
and usually involves complex movements, dedicated work, and compliance 
to the treatment schedule. Robotic rehabilitation contributes to this process 
and shortens the duration of treatment. In particular, patients’ access to the 
hospitals is a serious challenge. Rehabilitation robots alow home care of 
patients through internet-based remote control and programmable features. 
In the rehabilitation process, the measurement and recording of biomechan- 
ical and biological parameters of the patient with high accuracy and precision 
is extremely important in terms of monitoring the treatment process and 
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contributing to the treatments to be applied in other patients. Rehabilitation 
robots offer effective solutions to this problem with their sensors with high 
precision, accuracy, and resolution and databases that can store and analyze a 
large number of different data. In addition, they prevent the problems caused 
by subjective measurement and evaluation in manual treatment performed 
by a pyhsiotherapist. Therapeutic exercises consist of movements that 
require repetitive and same exercise conditions. A rehabilitation robot 
can apply the same force and ROM to the patient in the desired number 
and duration. The use of rehabilitation robots in rehabilitation centers 
and hospitals is increasing day by day due to the proven successes. Therapeu- 
tic exercises include ROM, strengthening, and active-assistive exercise 
movements. These movements correspond to position and force control 
in robot control. There is human (patient or physiotherapist)-robot interac- 
tion in a rehabilitation robot. Therefore, effective control, sensitive-fast 
feedback, and safety are very important factors in this interaction. The most 
known technique for position control of robots is proportional-derivative- 
integral (PID) control. Impedance control is used as the most effective con- 
trol method for the systems that are needed for human-robot interaction. 
Impedance control method was developed by Hogan (1985). It performs 
force and position control by adjusting the mechanical impedance of the 
end effector of robot. There are several versions of impedance control: 
position-based impedance control, force-based impedance control, hybrid 
impedance control, and variable impedance control. In position-based 
impedance control, position tracking can be performed by providing the tar- 
get resistance level. In the force-based impedance control, the resistance of 
the robot end effector against the patient can be adjusted. Hybrid impedance 
control method was developed by Anderson and Spong (1988). In this tech- 
nique, “impedance control” and “hybrid force-position control” strategies 
are combined under the same control structure. Thus, both position- and 
force-based impedance controls are combined within a single control struc- 
ture. This chapter is organized as follows: related work, theory of therapeutic 
exercises, impedance control techniques, modeling therapeutic exercises 
with impedance control methods, and impedance control-based robotic sys- 
tems developed by the authors. 





2 Related work 


There are many studies in the literature on the use of impedance con- 
trol methods in therapeutic exercise robots. Krebs et al. (1998, 2004) and 
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Hogan et al. (1995) developed a three degree-of-freedom (DOF) 
rehabilitation system named MIT-MANUS (Massachusetts Institute of 
Technology-MANUS) for shoulder and elbow rehabilitation. The imped- 
ance control method is used in the control of the system. The robot can per- 
form passive, active-assistive, and resistive exercises. Okada et al. (2001) have 
developed an impedance-controlled robotic system that can perform passive 
exercises for lower limbs in spastic patients. Nef et al. (2007) developed an 
exoskeleton robot for the shoulder and elbow rehabilitation which they 
called ARMin. This system has six DOF, including four active and two pas- 
sive, and can do passive and active-assistive exercises. It has the ability to per- 
form trajectory tracking applications, to give auditory and visual feedback, 
and to make gravity compensation. Impedance and admittance control tech- 
niques are used in the control of the system. Denéve et al. (2008) developed a 
three-DOF exoskeleton robot for shoulder and elbow rehabilitation. The 
robot can perform passive, active-assistive, and resistive exercises. PI and 
PID position control and impedance control methods were used in the con- 
trol of the system. Oblak et al. (2009) developed a two-DOF robot system 
for the rehabilitation of the wrist and forearm called Universal Haptic 
Device (UHD). UHD can perform daily activities (reaching, dropping, 
etc.). The system has two operating modes: wrist and forearm. The imped- 
ance controller was used as controller. Kiguchi and Hayashi (2012) devel- 
oped a seven-DOF exoskeleton robot system. The system is designed for 
wrist, forearm, elbow, and shoulder rehabilitation and can do active-assistive 
exercises. Impedance control method is used in the robot control. Ren et al. 
(2013) developed a six DOF, impedance-controlled exoskeleton robot sys- 
tem called as IntelliArm. The system is designed for wrist, forearm, elbow, 
and shoulder rehabilitation and can perform passive, active, active-assistive, 
and resistive exercises. Yeong et al. (2009) have developed a three-DOF 
wrist and forearm rehabilitation robot called ReachMAN (reach and manip- 
ulation). Admittance and impedance control methods were used in robot 
control. There are modes of pick and place, eating-drinking, and therapeutic 
exercise. Fraile et al. (2016) developed a robot for the rehabilitation of 
shoulder and elbow with two DOF, called E2Rebot. There is a handle 
on the robot which can be moved in X- and Y-axes. Impedance control 
method is used in the robot control. Kim and Deshpande (2017) developed 
a5 + 5-DOF exoskeleton robot for the rehabilitation of shoulders, elbows, 
and forearms, called Harmony, of the right and left arms. The impedance con- 
trol method is used. The authors also modeled therapeutic exercises using the 
impedance control method and developed robotic systems for lower- and 
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upper-limb rehabilitation called as PHYSIOTHERABOT®© (Akdogan and 
Adli, 2011), PHYSIOTHERABOT/w1© (Akdogan et al., 2018), and 
DIAGNOBOT®© (Aktan and Akdogan, 2018). The detailed information 
about these systems and explanation of the control methods are given in 
this chapter. 





3 Background of therapeutic exercises 
3.1 Movement types 


There are five fundamental exercise movements in rehabilitation (Fig. 1) 
(Griffith, 2000). 
Flexion: Bending limb or joint 
Extension: Extending limb or joint 
Abduction: Movement of a limb away from the midline of the body 
Adduction: Movement of a limb closer to the midline of the body 
Rotation: Rotating limb or joint 


3.2 Exercise types 


Therapeutic exercises are one of the most important applications of rehabi- 
litation. Unlike drug therapy, exercise procedures are not fully defined. This 
poses negativity for patients. Physical exercises improve strength, endurance, 
body, and limb motion capability. 

Therapeutic exercises can be classified as passive, active-assistive, and 
resistive exercises. The classification of therapeutic exercises is given in 
Fig. 2. Passive exercises are especially applied in patients without muscular 
contraction. They can be done manually or with the help of an exercise 
device. The active exercises include voluntary muscular contractions. These 
exercises can include active ROM or general stroke rehabilitation exercises 
and muscles move through therapeutic movements. The purpose of resistive 
exercises is to increase muscular strength. Resistive exercises can also be per- 
formed by hand or with the aid ofa therapeutic device. Isotonic exercises are 
increase muscular strength, power, and endurance based on lifting a constant 
amount of weight at variable speeds through a ROM. In contrast, isometric 
exercises are a type of strength exercise in which the joint angle and muscle 
length do not change during muscular contraction. In the isokinetic exer- 
cises, the joint velocity is constant and the system applies force against the 
person. Generally, athletes do this exercise. 





Flexion Extension 
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Fig. 1 Fundamental exercise movements (Openstax, 2013). 
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2 Therapeutic exercise types. 


Passive exercise: In passive exercise, movements to the patient are per- 
formed by a physiotherapist or by a device such as a continuous passive 
motion. Various robotic devices are also used for this purpose. The pur- 
pose of this exercise is to enable the patient to reach the normal ROM. It 
is usually performed in stroke patients. 
Active-assistive exercise: In this type of exercise, the patient is assisted to 
complete the movement when he cannot complete. The patient moves 
his limb to the point where he can move. The movement is then com- 
pleted by an external force. Unlike the passive exercise, it provides some 
increase in muscular strength and coordination. 
Resistive exercises: The resistive exercises are performed against a force. 
Muscle strength increases via resistive exercises. They are performed 
by a force against dynamic or static muscular contraction. 
Isometric (static) exercise: It is a static exercise with muscular contraction 
without any elongation of muscle length. Exercises such as applying 
force to a standing object, keeping a certain weight without moving 
the joint are isometric exercises. 
Isotonic (kinetic) exercise: In this exercise, resistive movement is made 
within a certain ROM limits. There is more strength increase than 
isometric movements. Isotonic exercise is done against gravity. They 
are performed with dynamic muscular contractions against a constant 
resistance over the ROM. 
Isokinetic exercise: It was developed in the early 1960s by American 
biomechanics expert James Perrine. With an isokinetic machine, 
the person works at a constant speed. Isokinetic exercise is a 
constant-speed resistive exercise. The speed remains constant, with 
the resistance set according to the muscle torque. Constant resistance 
increases as muscle effort increases. The basic theoretical advantage of 
this technique is to provide maximum muscular tension at full ROM. 
These exercises can be performed with an isokinetic exercise device 
or robotic systems. 
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Table 1 Control methods according to exercise types. 





Exercise type Control method 

Passive Position control 

Active assistive Position and force control 
Isometric exercise Force control 

Isotonic exercise Force control 

Isokinetic Force and velocity control 
Manual Position and force control 





Manual exercises: They are performed by the physiotherapist, depending 
on his expertise. In particular, stretching exercise is performed by phys- 
iotherapists. The condition of the muscle is observed by the eye and 
hand. According to the psychology of the patient and the physical con- 
dition of the muscle during the treatment, the physiotherapist changes 
the exercise process. On the other hand, Akdogan et al. (2009) achieved 
modeling of stretching exercise using robot control methods. 

These exercises can be modeled by position and force control in terms of 

robot control. Accordingly, the relationship between exercise types and 

control methods is given in Table 1. 





4 Impedance control techniques 


The impedance controlis based on the performing of force and position 
control by adjusting the mechanical impedance of the end effector of the 
robot. This mechanical impedance is caused by the relationship between 
the external forces and the end effector of the robot that is caused by the con- 
tact of the robot manipulator with the environment. Mechanical impedance 
is the behavior of mechanism elasticity against external force applied. Various 
impedance models have been developed. These models are mainly based on 
position and force. Hybrid control-based hybrid impedance control method 
has also been developed. Researchers have used this control method in robot 
control with some small differences. Impedance control is known as the most 
effective control method in human-robot interactive systems. Therefore, it is 
frequently used in rehabilitation studies. Therapeutic exercise movements 
require either position or force control. However, in some cases they require 
both position and force control. The use of impedance control modes 
according to exercise types is shown in Table 2. The types of impedance 
control techniques are explained in the following. 
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Table 2 Exercise type and impedance control mode relationship. 





Exercise type Control method 

Passive Position-based impedance control 
Active assistive Hybrid impedance control 
Isometric exercise Force-based impedance control 
Isotonic exercise Force-based impedance control 
Isokinetic Force-based impedance control 
Manual Hybrid impedance control 





4.1 Position-based impedance control 


The position-based impedance control model is frequently used in passive 
exercises requiring position control and active-assistive exercises that 
require position and force control. This control method was used in 
PHYSIOTHERABOT and DIAGNOBOT. In this section, the general 
model of this method and another model developed by Yoshikawa (1990) 
which has small differences from the general model were also introduced. 


4.1.1 General model 
The dynamic equation of a robot is given by the following nonlinear 
equation: 


t= M(q)4+ C(4,4) + G(q) +f(4) (1) 


where M(q), C(q,4), G(q), and f(q) are the inertia, the Coriolis and 
centrifugal forces, the gravitational force, and friction forces, respectively. 
The vectors q, q, and g are the angular position, velocity, and acceleration 
of the robot joints, respectively. 

The main equation of position-based impedance control is given in the 
following equation: 


My(x — %4) + Bax — xq) + Ka(x — x4) = —Foxet (2) 


where M,, By, and K, are symmetrical matrices that denote the desired 
inertia, damping, and stiffness matrices, respectively. The vector x denotes 
the actual end effector position and x, denotes the desired end effector posi- 
tion. The vector F,,, is the force applied to the manipulator, which is the 
output of the force sensor. Eq. (2) is arranged as 





x=x4+M,*| Ba(x — xa) — Ka(x — xa) Fez] (3) 
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The relationship between linear velocity x and angular velocity 0 is given 
by following equation: 


x=J(q)4 (4) 
where J(q) is the Jacobian matrix and the linear acceleration is 
¥=J(gatJa (5) 


In the robot dynamic equation given by Eq. (1), let us choose the control 
input as follows: 


= M(q)u+ C(q,4) + G(q) +£(4) +I (Q) Pen (6) 
where u=q. Accordingly, Eq. (5) can be written as 
u=J(q)' (F(A) 7) 


where (.)' denotes Pseudo inverse of matrix. If we replace Eq. (3) in Eq. (7) 





u=J(q)' (%a+ My '[—Ba(% — 4) — Ka(x— xd) — Feel —J(4) 8) 


If we replace Eq. (8) in Eq. (6), we obtain the control rule for position-based 
impedance control as follows: 





t = M(q)J(q)" (aia + My '[-Ba(& — a) — Ka(x — xa) — Fext] —J(4)4) + C(4.4) 
+ G(q) +£(4) —J(Q)" Fest 
(9) 


4.1.2 Position-based impedance model of Yoshikawa 

Yoshikawa (1990) developed a position-based impedance model. This 
model is used in PHYSIOTHERABOT. In this model, the contact force 
is expressed in terms of the desired impedance parameters: 


Myx + Baxe + Kaxe = Foxt (10) 


where x, desired position vector and x, = x — xq. The dynamic equation 
defined in the joint space of the robot manipulator in contact with its envi- 
ronment is given by the following equation: 


M(q)4+ hn (4.4) =t tJ" (q)Fext (11) 


where M(q) € R™" is inertia matrix at joint space, hy(q,q) € R"! is Cor- 
iolis and centrifugal force vector at joint space, and t € R"! is joint torque 
vector. The important point here is that since the robot has a relationship 
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with its environment, it defines the work space in Eq. (11), which is defined 
in the joint space 


My(q)X + hy (4.49) =Je (qt + Foxe (12) 


where M,.(q) €R"*" is inertia matrix, h,(q,q)€IR’”! is Coriolis and 
centrifugal force vector, and J, € R"' is Jacobian vector. These vectors 
and matrices are defined at workspace. 


x =f.(q) (13) 
x =Jy(q)4q (14) 
- = ]07 ie (15) 


It is possible to express the M.(q) matrix in the work space and the vector 
h;(q,q) consisting of nonlinear terms in terms of M(q) and hy(q,q) in the 
joint space. 


M.(q) =Je"™M(aye' (4) (16) 
h(q.4) =Je Thy (4.4) -—Me(q) (94 (17) 


Using Eqs. (12), (16), (17), the required joint torque to obtain the desired 
impedance parameters Mj, Bj, and Ky, can be found by the following 
equation: 


t=hn(4.4)-M(qe'(a)I(aa— M(ae (a) Mz | (Bay, + Kirve) 


(18) 
+ ([M(q)Je'(Q) Me! —Je (Q) Few 


The block diagram of Yoshikawa’ impedance model is given in Fig. 3. 






—1p4—-1_ 7T 
MJ'Mg'- JT 


Direct kinematics 


Fig. 3 Yoshikawa’ model block diagram. 
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4.2 Force-based impedance control 


For the force-based impedance control, the desired dynamics behavior of 
the system can be given as follows: 


Myx + Bax — Fy = —Foxt (19) 
which is equal to 
e=M;'(—Bye+Fj—Fy) (20) 
where Fy is desired force. If the expression in Eq. (20) is written in Eq. (7): 
w= G=J(q)' (Mz (—Bik + Fa — Fox) —F(9)4) (21) 
Eq. (21) is written in Eq. (6), the general torque equation is obtained 


t= M(q\I(q)" (Mj! (Fa — Fext — Bax)) —J(Q)@) + C(a.a) + G(Q) + f(D) 
+J(q)" Fext (22) 





4.3 Hybrid impedance control 


Hybrid impedance control method was developed by Anderson and Spong 
(1988). Hybrid impedance control consists of combining the position- and 
force-based impedance control under a single control rule. It is an extremely 
useful control method for exercises that require both position and force 
control. In hybrid impedance control, the controller can operate in force 
or position control mode. This selection is performed with a selection 
matrix (S). If the matrix “1,” it works as position based, and if “0,” it works 
as a force-based impedance controller. The desired dynamic behavior of 
the system is a combination of Eqs. (2), (19), which includes the switching 
matrix. 


Mix = SX4) a By(x = Sx4) + SKy(x — x4) + (I = S) Fy = — Foyt (23) 


Final control rule for the desired dynamics 





t= M(q)J(q)" (Sita + Mj "[(I — S) Fu — Fox — Base — Ska) 


SKi(x—4)] —J()4) + Clad) + Cla) + FQ) JQ)" Fen 





4.4 Variable (angle-dependent) impedance control 


In variable impedance control method, B, varies according to the angle of 
the joint. When the ROM is 0 degree, B, takes the maximum value (Bamax)- 
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B, decreases as the joint moves to the maximum ROM, and By receives the 
smallest value (Bymin) when it reaches the maximum 6 value. 


ABy — Bamax i. Bamin (25) 


The change of By can be written depending on the actual position (0) and 
maximum position (Anax) 


(Onze ~~ \0|) 


max 


By = AB, (26) 


When @ reaches the O0nax value, By becomes zero. This leads to unstability of 
the system. For this reason, the Bymin 1s added to Eq. (26) and the following 
equation is obtained. 


By = (Ca= ~ |0|) (Bamax ~_ Bamin ) (Omax) | + Bamin (27) 
The resulting control law after combining Eqs. (22), (27) becomes 


C= M(q)I(q)' (Mz! (Fa > Fost oa [(@rnare — |0|) (Bamax _ Bémin)(Omax) | 


+ Bimin)) —J(q)4) + C(4.4) + G(4) +F (4) +J(q) Fe 
(28) 





5 Therapeutic exercise modeling via impedance control 


The algorithms for modeling the therapeutic exercises with robot 
control are given in the following sections. 


5.1 Passive exercise 


This type of exercise is applied to patients with little or no muscle contrac- 
tion, in particular. The patient’s limb is moved in the ROM. There is no 
resistance during the motion. The therapist can describe exercise parameters. 
These are ROM, repetition number, and the velocity of movements via a 
graphical user interface (GUI). The passive exercise requires position 
control. Therefore, the robot manipulator can make its moves using the 
position-based impedance control. The desired trajectory is produced by 
the main controller of the robot manipulator in accordance with the 
specified ROM and velocity inputs. The algorithm of the passive exercise 
is shown in Fig. 4A. 
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Fig. 4 (A) Passive and (B) active-assistive exercise flow chart. 


5.2 Active-assistive exercise 


The active-assistive exercise is a type of exercise performed by physiother- 
apist and patient together. In this exercise, the patient moves his limb to the 
extent he is capable of. The patient is assisted by the robot manipulator, 
which replaces the physiotherapist from the position where he can no longer 
move his limb. This exercise is applied to patients with a muscle degree of 2 
and 3. (The degree of muscles are evaluated with a scale that has six levels. 
This test is done by physiotherapist manually.) The GUI input parameters 
are the ROM values. The patient’s limb weight is eliminated by the robot 
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via compensation of the gravity effects using impedance control. This way 
the patient is enabled to move his limb to this level easily despite his muscle 
weaknesses. In the selection of the impedance control parameters, criteria 
such as enabling the patient to move his limb at the lowest possible level 
of resistance and eliminating any possibility of causing vibration in the 
mechanism during the motion is considered. These parameter values are 
determined experimentally and are stored in the database. By evaluating 
the force sensor signals, the position at which the patient cannot move 
the limb during exercise is determined. This force value arising in the oppo- 
site direction of the movement is detected by the controller, which in turn 
activates the position control algorithm for the completion of the motion. 
Then, the patient’s limb is moved to the limit of the ROM with constant 
velocity and then brought back to the starting position also at constant veloc- 
ity. For the algorithm of this exercise refer to Fig. 4B. 


5.3 Isometric exercise 


Isometric exercise is performed with the application of constant resistance in 
a certain position. However, the ROM does not change whereas his muscle 
tone increases. The algorithm of the isometric exercise is shown in Fig. 5A. 


5.4 lIsotonic exercise 


During an isotonic exercise, the limb is moved against a constant force. The 
ROM changes, but the counter-force is kept constant. In order to model 
this exercise, impedance controller is used in the force control mode. 
The input of the controller is the target force. The algorithm of the isotonic 
exercise is shown in Fig. 5B. 


5.5 lIsokinetic exercise 


The purpose of this exercise is to maintain maximum muscle contraction by 
keeping the patient’s limb at a constant level. It is applied athletes whose 
muscle degree is the highest level. When the exercise is started, the imped- 
ance control starts operating with low impedance parameters and the athlete 
moves his limb. The speed of limb movement is continually detected by the 
software. If the speed reaches the predetermined level, the generated limb 
force value is calculated and this force is applied instantaneously to the leg 
on the opposite direction of the movement. Thus, even if the patient tries 
to increase the limb speed, the force generated in the opposite direction to 
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Fig. 5 (A) Isometric, (B) isotonic, and (C) isokinetic exercise flow chart. 


s repetition 
number 
completed? 








the movement keeps the speed of the movement constant. The algorithm of 
the isokinetic exercise is shown in Fig. 5C. 





6 Impedance-controlled rehabilitation robots 


In this section, three therapeutic exercise robots that are controlled 
using impedance control are explained. First, three-DOF lower-limb robot 
that is called as PHYSIOTHERABOTO is introduced. Its controller is in 
the form of an intelligent controller supported by a position-based imped- 
ance controller. It models not only therapeutic exercises but also manual 
therapy that is performed by a physiotherapist. Second, three-DOF 
upper-limb robot that is called as PHYSIOTHERABOT/w1 is explained. 
It is controlled by a hybrid impedance controller to model upper-limb exer- 
cises. Finally, DIAGNOBOTO is an intelligent robotic rehabilitation sys- 
tem developed to assist physiotherapists and physicians in diagnosis and 
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treatment during wrist and forearm rehabilitation. Its controller structure 1s 
developed via the force-based impedance control. 


6.1 PHYSIOTHERABOT 


PHYSIOTHERABOT is a three-DOF lower-limb rehabilitation robot. It 
can perform knee and hip rehabilitation. In addition to perform passive, 
active-assistive, and resistive exercises for these joints, it can learn the move- 
ments of the physiotherapist and apply it to the patient. The position-based 
impedance control was used to model the exercises in the system. 
Yoshikawa’s model was used for this purpose. It has a unique patented 
mechanical design (Akdogan, 2008). All the motors of the system are placed 
on the base. Therefore, masses of motors do not affect the system dynamics. 
The knee joint of the robot has a pantograph structure. 

For detailed information and experimental results ofp PHYSIOTHERABOT, 
please refer to Akdogan and Adli (2011) and Akdogan et al. (2009). 

PHYSIOTHERABOT consists of four basic elements. These are 
physiotherapist, intelligent controller, robot manipulator, and patient. 
The general block diagram of the system is given in Fig. 6. In the system, 


€ > Therapy and patient 


information 


= | 
a 3) | a ie 
“3 y, 

“4 Intelligent 


controller 


Therapy results 





Physiotherapist Actual Desired 
force torque 

and and 
position position 


Reaction 


; Physiotherabot 
M 


ovement 





Patient 
Fig. 6 PHYSIOTHERABOT general block diagram. 
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the physiotherapist first enters the patient information (age, weight, height, 
and foot length) into the system using the user interface. He also selects the 
movement type and exercise type and enters the exercise parameters (period, 
repetition number, ROM, velocity). The control of the system is carried out 
by the intelligent controller. The information required for the robot manip- 
ulator to move (position-torque) is calculated by the intelligent controller 
and sent to the manipulator. The response from the patient during the exer- 
cise can be evaluated by the intelligent controller and the process (applied 
position and force) can be changed. Detailed information about system ele- 
ments is given later. The system is capable of performing passive, active- 
assistive, isotonic, isometric, isokinetic, and manual (called in the system: 
robotherapy) exercises. Manual exercises are performed in two stages: teach- 
ing mode and therapy mode. In the teaching mode, the physiotherapist per- 
forms the exercise with the robot manipulator. In the therapy mode, the 
robot manipulator applies exercises to the patient using the knowledge 
acquired in the teaching mode. The basic elements of the system are 
explained in following sections. 


6.1.1 Intelligent controller 

The intelligent controller is the management unit of the system. Commu- 
nication between all the elements of the system is performed by this unit. 
The system has the ability to perform muscle testing, as well. As a result 
of the muscle test, the patient’s muscular degree and ROM are detected 
and shown on the screen. Information such as posttherapy ROM, patient 
force, and patient response force can be observed graphically and numeri- 
cally. The intelligent controller consists of central processing unit, conven- 
tional controller, database, rule base, and user interface. The intelligent 
controller block diagram is given in Fig. 7. 

The system requires force and position control to perform exercises. In 
order to construct the controller structure, the desired force and position 
control have been carried out according to the exercise types with conven- 
tional control methods. For different types of exercises, a database and rule 
base have been created as it is necessary to select different conventional con- 
trol techniques, keep control parameters in a database, and change the 
parameters. A user interface is available for the user to control the system. 
The communication between the conventional controller, database, rule 
base, and user interface is provided by the central processing unit. The func- 
tions of the units that constitute the intelligent controller according to the 
exercise types are given in Table 3. Position-based impedance control for 
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Fig. 7 Intelligent controller block diagram. 


exercise types requiring force control and PID control method for exercise 
requiring position control were used. Some types of exercise require a com- 
bination of force and position control. In these exercise types, impedance 
and PID controls are used together. The reason for selecting impedance 
control is that the system can resist the desired softness or stiffness by chang- 
ing the impedance parameters. The physiotherapist should be able to 
perform the movements in a very easy and gentle way while performing 
the exercise movements. Moreover, the resistance level is obtained by 
changing the values of the impedance parameters in the resistive exercises. 
The central processing unit performs the following tasks as common to 
all types of exercise: 
- Algorithm selection 
- Send patient parameters that are stored in the database to the algorithms 
- Send the data from the sensors to the rule base and database 
- Send information from the rule base and the database to the controllers 


6.1.2 Robot manipulator 

The developed robotic system has three DOF and can perform flexion- 
extension for the knee and flexion-extension and abduction-adduction 
movements for the hip. Servo motors are used to actuate the mechanism 
and force sensors are used for force measurement. It can be adjusted 
according to the limb size and is suitable for both legs. The general structure 
of the robot manipulator is given in Fig. 8. The knee link (Link 2) of the 
PHYSIOTHERABOT was designed according to the parallelogram prin- 
ciple. The robot manipulator’s motors are placed on the base to reduce the 
effects of motor weights on the robot manipulator dynamics. 
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Table 3 The functions of the intelligent control unit 


Mode 


Central control unit 


Database 


Rule base 





Muscle test 


Passive 


- Sends force and 
position data to 
rule base. 

- Sends maximal 
torque data to 
controller. 

Determines the 
motion trajectory 
according to 
ROM and 
velocity and sends 
it to the database 
and PID 
controller. 


Active assistive According to 


Isotonic 


Isometric 


information from 
the force sensor, 
“patient cannot 
move the limb” 
information is sent 
to the rule base. 

- According to the 

resistance level, 

takes the imped- 
ance parameters 
from the database. 

Evaluates the posi- 

tion data and cal- 

culates the number 
of repetitions and 
sends it to the 

rule base. 

- Sends the imped- 
ance parameters 
according to the 
selected technique 
from the rule base 
to the controller. 

Sends the weight, 
duration, and 
length of the limb 
from the database 
to the controller. 


Stores maximal 
torque data and 
patient muscle 
level. 


Stores motion 
trajectory. 


Stores length of the 
limb. 


Determines muscle 
degree. 


Activates PID 
controller if force 
is detected in 
reverse direction 
on force sensor. 


- Stop therapy if the 
number of repeats 
is complete. 

- Determines the 
appropriate 
impedance param- 
eters according to 
the resistance level. 


Detects impedance 
parameters 
according to the 
resistance level. 





Continued 
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Table 3 The functions of the intelligent control unit—cont'd 





Mode Central control unit Database Rule base 
Isokinetic Sends the velocity - - 
information to the 
controller. 
Teaching Determines the Stores the force and 7 
maximum force, position data 
and position data during the therapy 
during teaching applied by the 
and sends these physiotherapist. 
values to the 
database 
Intelligent - Updates the rule Holds the duration, Identifies the 
therapy base with maxi- maximum force, relevant data file 


mum force and 
position informa- 
tion in the database 
and send them to 
the controller. 

It takes the maxi- 
mum position data 
in the database and 
the force-position 
data required for 
the healthy people 
to reach that posi- 
tion and sends it to 
the controller 


and position data 
during teaching 
and exercise 
parameters. 


according to the 
patient’s weight 
and the maximum 
ROM obtained 
during learning. 
When the force 
and position limit 
values are 
exceeded 
according to the 
real-time data 
from the central 
processing unit, 
the PD controller 
activates. 





6.1.3 Electronics hardware 

The electronics hardware block diagram of the PHYSIOTHERABOT is 
given in Fig. 9. System hardware consists of servo motors, reductors, motor 
drivers, data acquisition cards, encoders, force sensors, limit switches, and 
emergency stop buttons. 

Digital force and position data from the intelligent controller are 
converted to analog current (torque) data via DAQs and sent to the motor 
drivers. Data from the force and position sensors on the robot manipulator 
are sent to the intelligent controller via the DAQs. The limit switches pre- 
vent the mechanism from moving beyond the required limits. 
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Fig. 9 The electronics hardware diagram of the PHYSIOTHERABOT. 


416 Erhan Akdogan and Mehmet Emin Aktan 





6.1.4 Dynamic analysis 
Knee and hip rehabilitation were independently modeled and controlled 
in PHYSIOTHERABOT. The dynamic analysis and control method is 
explained here. 
Knee joint dynamic analysis: The general dynamic model of a robot manip- 
ulator was given in Eq. (11). The knee joint is a single DOF and can be 
modeled like a pendulum driven by the axis of rotation as shown in 
Fig. 10. 
The dynamic model for the knee joint can be expressed by the folowing 
equation: 


L6> + T grav2 = 72 am hae (29 


) 
Jp =S2= be (30) 
J) =1/Le G1) 
hn = T grav2 = mg sin 02 Lo (32) 
where J, is moment of inertia of link 2, 6» is angular acceleration of link 2, 
Tgrav2 18 gravity effect, J,» is the Jacobian of link 2, and L,» is the distance of 
the center of mass of the link 2 to origin. 
Hip joint dynamic analysis: Hip flexion-extension movement is a motion 
with two DOF. Links 1 and 2 work together to perform this movement 
in the system. Fig. 11 indicates the center of masses of links 1 and 2 that 
perform hip flexion-extension movement. 
The physical parameters of the PHYSIOTHERABOT are given in 
Table 4. 
Transforming force sensor coordinates into workspace coordinates: There are two 
force sensors in the system. These sensors are positioned to the ankle in 
link 2 to measure the knee forces, and to the thigh in link 1 to measure 





Fig. 10 The model of link 2. 
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Fig. 11 The center of mass of links 1 and 2. 


Table 4 Physical parameter values of the PHYSIOTHERABOT. 





Part number Mass (kg) I, (m) 
11 1.955 0.3 

21 3.25 Variable 
22 0.75 = 

23 0.18 0.09 
Hip apparatus (ha) 4.25 0.25 





Note: |, is the distance of center of mass to the origin. 


the hip forces (Fig. 12). Since the axes of these sensors and the workspace 


are different from each other, necessary coordinate transformations 


should be made. The axes of the sensors and the workspace and the 


angles between them are given in Fig. 12. In the figure, “r” subscript rep- 


co 99 


resents the work space of the robot and “s” subscript represents the axes 


of the sensors. 


The equivalent of the forces measured from the hip sensor (f1,, f(1-) in 


the workspace coordinates (X,, Z,) is given in the following equation: 


Fy= Fux cos 0, ~ Fyz sin, 
Fy, = —Fy,sin@, — Fy, cos) 


(33) 


The equation of the forces measured from the knee sensor (fio,, f(2=) in the 


workspace coordinates (x,, Z,) is given in the following equation: 


Fg = Fe, cos 02 — Fo, sin 82 
Fy = —F 2, sin 0 = Fo. COs 0 


(34) 
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Fig. 12 Sensor and workspace axes. 


Coordinates of sensors mounted to the links and Jacobian matrix: The coordi- 
nates of sensors connected to links 1 and 2 and the calculation of their 
velocity are required for the calculation of the Jacobian matrix. The 
coordinates of the sensors connected to the links and the calculations 
of the Jacobian matrix are given here. 
The coordinate of the hip sensor connected to the link 1 and the Jacobian 
matrix: The Jacobian matrix is obtained using the following equation: 


=a 


= iy (35) 


ei 


where p is the position of the sensor. 
The coordinates in the x- and z-axes and partial derivatives of the sen- 
sor are given in the following equation: 


x1 = 1, cos (2a — 0) = 1y cosO; — 6x1 = 1,60; sin a 
21 = 1,4 cos (2a — 61) = 1,1 cosO; — bz; = 1,60) cosO; oo) 


x4 - —ea sin, 50; 
621 I, cosO; 
The Jacobian matrix for the link 1 is given in the following equation: 


1, cosO, 


=| 
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The coordinate of the knee sensor connected to the link 2 and the Jacobian 
matrix: The coordinates in the x- and z-axes and partial derivatives 
of the sensor are given in the following equation: 


x2 = 1, cosO; + 1 cosO2 — 6x2 = —1,69; sin; — 1,602 sin 2 
22 =—lsinO, — 1 sin@2 — dz2 = —1,60; cos@; — 11602 cos O2 


0x2 _ —l,sin@; —r, sin @> 00, 
622} | —l, cos, —1r cos@> | | 605 


Jacobian matrix for link 2 is given in Eq. (39). The transpose, inverse, and 


(38) 


derivative of the Jacobian are given in Eqs. (40)—(42), respectively. 





—l,sin@; —nsin@, 
2 = (39) 
—l,cos@; —1cosO, 
—l,sin@; —l,cos@ 
T _ 1 1 1 1 
Je = ees —F oe eo) 
= —1 si 1 
I = 1 COSA nsinO> (41) 
I,cos#,; —h sin | lr, sin@, cos@> + Ln cos 0) sin@> 
- | —160, cos, —11,602c0s@, 
J -| 1,60; sin 0, 1005 sin @5 | 2) 


Dynamic equations: For calculating the joint torques of the robot manip- 
ulator, the dynamic equations of the system must be calculated. In cases 
where no external force is not applied, the Lagrange equation given in 
the following equation is used in the joint torque calculation: 


dédK 6K OP 
T= : a 
dt6@ 60 60 





(43) 


where P and K are the potential and kinetic energy, respectively. 
The coordinates of the robot manipulator parts: 

In order to calculate the kinetic and potential energies in the Lagrange 
equation, the positions and velocities of the robot manipulator and lower- 
limb parts (Figs. 11 and 13) must be found. These equations are given in 
the following: 

Part 11: 

X11 = lett cos), _ x1 = — 11101 sin), 


44 
211 = hy Sin; > 241 = 1101 cos; va 
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Fig. 13 Lower-limb parts. 


Hip apparatus (ha) part: 


Xha = 0.25 cosO, > Xha = —0.250) sinO, (45) 
Zha = —0.25sinO, > 2, = —0.250; cosO, 
Thigh part: 
thigh = lethigh cos 0, = Xthigh = —0.144 human sin; 
211 = —lehigh SIN O1 — Z thigh = —0.144 Iyuman COSA, (46) 


letchigh =0.1 44 lnuman 
Part 22: 


x29 = (ly — b + lor) cos, + in4 cosO> 

op = — (1, — b+ 0.2)0; sin, — 0.202 sin 0, 

209 = (li — b + loz) sin (2a — 0) — In1 sinO> (47) 
zy =—(h—bt+ 0.2) cos0; — 0.20 cosO> 

loy = 0.2 [m] 
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Shank part: 


Xshank = ly cos@; + Laban cos@2 — Xshank = —01 sin; — IeshankO2 sin 82 
shank = —h sin, res lpshiatile sin 8, —< Zshank = —10; cosO; os IshankO 2 cosO, 
beak = 0.144 human 


(48) 
Foot part: 


a . 
Xfoor = | cos, + Ip cosOz + lofoor COS é — 62) — Xfoot 


= —1,0; sin 9, = 1305 sin 05 = Ipfoot2 sin E- 6) 


a . 
foot = —h sin 0; — bg2 sin 82 + lefoot sin (5 = 0) —~ Zfoot (49) 


; F are ia 
a —1,0; cosO, = [2392 cos =, foot 92 sin. ¢ = 6.) 
lefoot = 0.429 lisot 

where |yuman is height of patient, lenighs loots AN Iyhank are Mass of centers 
of thigh, foot, and shank, respectively. 

The kinetic energy of the robot manipulator parts: In order to calculate the 

kinetic energy used in the Lagrange equation, the kinetic energies of 

the robot manipulator components are calculated separately and given 


in the following: 
Part 11: 


1 2 1 +2 a. 
Ki = smite Fo fetih p= 9,1228) (50) 
Hip apparatus(ha) part: 
1. ss 
Kus shad = 0.13207 (51) 
Thigh part: 


1 : 
Kerigh = 5 kien = 1077[(21, 186BW — 222,796) + 20.736menign 


ae 
(52) 
where BW represents body weight and m is mass of part. 
Part 21: 


1 is. ¢ 
Ky = jiai (31 +2) + sland = 1.625(«3, + 23,) + 0.046; (53) 
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Part 22: 
Re we eee 2, +32,)+2.830, (54 
22 = 5 1122(% 29 2p) 5 1c2 27> 0.375( x3, 2p) 836, (54) 
Part 23: 
i He SRF Sd y2 __ 59 ele 472 
Ky = 5 1123(%25 + Boa) + 3 1a2395 = O95. + 255) + 4.6587 x 10 0, 
(55) 
Shank part: 


1 2 
+2 +2 2 
Kshank = Mitac Oz a Peach) + =I cshank9> 
2 2 (56) 


= 1077(5341 BW + 44,749) 


Foot part: 
1 1 
Keoc= 5 Moor Xfoo +32 y+ 5 laioo = 1077(355BW +7296) (57) 


The potential energy of the robot manipulator parts: In order to calculate the 
potential energy used in the Lagrange equation, the potential energies of 
the robot manipulator components are calculated separately and given 
the following: 


Part 11: 
Py = m419211 = —5.75sin A, (58) 
Part hip apparatus: 
Pha = MhaQZha = — 10.423 sin, (59) 
Part thigh: 
Prrigh = MrhighS2thigh = —1-412( thigh fnuman) sin (60) 
Part 21: 
P21 = mz) 9221 = —31.88(0.68 sin; + I, sin@2) (61) 
Part 22: 


Po = M222222 = 7.3575|(0.68 —b+ Iyo2) sin (27 = 0,) —0.2 sin 9>| (62) 
Part 23: 
Px = 732223 = —1.7658(0.68 sin 0; + 0.09 sin >) (63) 
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Shank part: 
Pyhank = Mshank&2shank = —Mshank9-81 (0.68 sin 8, + 0.144 lyuman Sin 62) 
Foot part: 

Proot = Mfoor&=foot 


=a Rt (0.08sina + OSs Os — 1s, 0420s (5 = 0) ) 


(64) 


(65) 


The contribution of the parts to joint torques: The contributions of the parts 


to the joint torques calculated using the Lagrange equation: 


For Joint 1: 
7111. = 0.2446; —5.75cos0; 
Tiha = 0.2650, — 10.243 cos0; 
Tithigh = othigh1 "ot 1.412Mhigh human cos A; 


34 3.25770, + 3.251 15 cos (0; = 03) 
“Te. 3.251, 1100(O> = 6,) sin (A —@>) 





Tr 3.25), 110105 sin (0; = 03) — 21.67 cos A, 


7122 =(0.75(ly —b + 0.2)* + 5.66)81 + 0.1563 cos (0, — 02) 


a 0.1509(A0 — 61) sin(O; — 62) — 0.1501 42(h —bt+ 0.2) cos (02 — 61) 





+ 7.3575(0.6 — b+ lyon) cos} 
7123 = 1.81701 + 1.81 1p2302 cos (01 — 02) + 1.81 192382(A2 — 01) sin (01 — 02) 
+ 1.81 [930102 sin (0; — 0) — 1.2cosOy 
TI shank = Mshank {91 + leshank 92 Cos (91 — 42) + leshank92 (02 — 91) sin (04 — 02) 
+ mshank!t lyshank 9192 sin (1 — 02) — Mehrank6-6708 cos 
C1foot = FO1 + Kor + mio! 2 (Be — AsinO,) + mfor[2h 283 cos; sin8> 
+ 2651, Iefoot Sin. 92 cos — 2051, 0, Bsind, 
+ 205 sin 9} Ij lofooeSinO2 + 20511 b sin O2 sinO 
— 2001 1, AcO,] — Mésot9292 (Io sin 9 sin, 


+ Igfoot Sin 2 sin ) + 2001 (sin lefoot COS 2 





+ sin, lp sin@2) — 6.67 cosO, 


(70) 


(71) 


(72) 


(73) 
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A= Lefoot sin ¢ _ 6) = Lb sin @ (74) 
B= b COs 02 = Lee sin @ = 6.) (75) 

For Joint 2: 
T211 = T2ha = T2thigh = O (76) 


7291 = 3.251} 1918 cos (01 — Oz) + 3.251910 + 0.0805 + 3.2514 1p 1 (82 — 1) sin (01 — 2) 
— 3.25009 sin (0, — O) — 31.8811 cos 
(77) 
1299 =0.15(ly — b+ 0.2)61 cos(01 — 2) + 0.0309 + 0.154 (ly — b+ 0.2) (89 — 41) sin(01 — 9) 
—0.150409(ly — b+ 0.2) sin (0, — 02) — 1.4715cosO9 
(78) 
7793 = 1-81y231164 cos (01 — 02) + 1.819939 + 4.6587 x 10465 + 1.81 19930 (82 — 81) sin (0) — 02) 


- 1.81, 1030402 sin(@, — 0) — 0.16cos09 


(79) 
7 r a > 
T2shank = shank!1 Ieshank9 1 cos (91 — 82) + 03 (mshank Thal = Tgshank) 
+ Mghank 1 Ieshank9 1 (92 —84)sin (01 — 0) (80) 
= Mshank tchanik® 1 05 sin (01 — 02) — mohank 1.41264 cosAg 
T2foot = foot! 04 cos0, B+ Mgyo¢92 B- + moot! a4 (Bos, - 04 Bsin01) 
= MS ¢9 1 Ooh; (-» sin@ cos@, — lofoot cos é - 0») cosO4 
4 . = 
—lefoot cos ( - 02) sin@1 + Ip cos@9 snd) 
=Méoot 981 (03 cos — Ig 5¢0.429 sin ( = 02) ) (81) 


Joint torques: The joint torques can be calculated by using the sum of the 
contributions of the parts to the joint torque and using the following 
equations: 


T =T111 TT iha + Tithigh + T121 + T122 + 7123 + Tishank + Tifoot (82) 


T2 = 7211 + T2ha + Tathigh + T221 + 7222 + 7223 + Thank + T2foot (83) 


Robot dynamic equation for hip exercises: In the case of external force acting, 
the dynamic equation of a robot manipulator is as in Eq. (11). Coriolis, 
gravity, and other effects and inertial matrix M can be calculated using 
Eqs. (82), (83), (11). The inertia matrix in Eq. (11) and all the informa- 
tion in the hy vector are given in the equations between Eqs. (66) and 
(81). Accordingly, the M(@) matrix 
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Ma, M22 


; 13.95/24 2s ge) e492 42 4 
My1 = 0.244 + 0.265 + Iothigh + 3.2517 + (0.75(ly — b+ 0.2)7 + 5.66) + 1.8/7 +17 + Ipooe (85) 


aif ie | (34) 





M12 = 3.2514 Io cos (04 — 09) +0.15cos (04 — 09) + 1.81, 1993 cos(O4 = 03) 


86 
+loshank cos(0, —02) + Moot (Bcos1 — Asin64) va 
M1 = 3.2514 lot cos (91 - 03) + 0.15 cos (ly —b+ 0.2) cos (1 — 02) + 1.8lo03/4 cos (94 _ 09) 87) 
+iMchank!'1 loshank cos(0, —02) + Moot Bly cosy 
Mg = 3.25ly91 + 0.11 + 1.8ly93 + 4.6587 x 10~4 + shank eshank a ea ic (88) 
hx (6,0) vector: 
hy (0,0 
hy(0,0) = | x1 8,8) (39) 
hyx2(8,0) 


hn (0,0) = — 5.75cosO, — 10.243 cos, — 1.412mhioh human 


cosO, + 3.251, 11 9(02 - 81) sin(Oy — 05) 
+3.2511 |y1 812 sin (0 — 2) — 21.67 cos +0.1509 (42 — 01) sin (0; — 42) 

—0.15(ly — b+ 0.2)890 1 cos (Oz — 1) + 7.3575(0.6 — b + ly97) cos} + 1.814 1p9302 (02 
—91)sin (81 — Ay) + 1.814 19349 sin (0, — Og) — 1.2c0s4 +H lyshank92(82 

~ 91) sin (1 — 93) + mrank lt leshank 41 42 sin (81 — 82) — Mshank6-6708 cos} 

+g so41282¢4 | 1p sin Oy + 20314 leo} sind cos0y — 2014 04 Bsind 

+267 sinO | It left Sin 82 + 2051 Ip sin sina — 2040 ly Acos |] 


= Mor 192(lo sin sinO4 + 204 09(sind, lefoot + sin 94 1p09)) — 6.67 cosO4 


hy2(0,0) = — 3.251} ly 94 (82 — 94) sin (1 — A) — 3.2501 82 sin (91 — A) — 31.88ly94 cos 





+ 0.1504 (A — 04) sin (04 —A9)(y — b+ 0.2) — 0.15(ly — b + 0.2)(904 )sin(O, — A) 


— 1.4715 cosy + 1.811 19394 (82 — 94) sin (81 — Ay) — 1.81 [9381 82 sin (91 — 99) 


— 0.16 cos@9 + Mehank!t IshankO1 (45 = 61) sin (9, — 99) — Mshank 1 leshank 9192 sin (0, — 09) 


— Mhank 1.41264 cos62 + Mor I (B cosO4 — 4 BsinO,) + mgsot91 Aol (=p sinO9 cosO4 


- lofoot cos (£- a2) cos04 — Iefoot cos (E- 02) sinO, + Ip cos@9 sin9 ) 


. a 2 
= Mot 9-81 | 0.5.cosO9 — Ipyot sin 5 02 0.429 


Jacobian vector Jy: 
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The equations related to the Jacobian matrix are given in Eqs. (37), (39), 
(40). The external forces F,,, acting on PHYSIOTHERABOT are given 
in Egs. (33), (34). 


6.1.5 Position-based impedance control of the PHYSIOTHERABOT 
Impedance and PID control techniques, which are conventional control 
techniques, have been used in PHYSIOTHERABOT to perform knee 
and hip movements and to apply appropriate force and position values 
according to the exercise types. 

For the exercises that require force control, impedance control and for 
the exercises requiring position control, PID control methods were used. 
Some types of exercise require a combination of force and position control. 
In these exercise types, impedance and PID control were used together. 
Table 5 shows the exercises that the system can perform and the conven- 
tional control methods used in these exercises. 

The control of the system was performed in three stages, which could be 
performed for flexion-extension of the knee and flexion-extension and 
abduction-adduction movements of the hip. In the first stage, the control 
of the flexion-extension movement of the knee joint with single DOF 
was performed, and the hip flexion-extension movement control which 
required the joint movement of the knee and hip joint in the second stage, 
and the hip abduction-adduction movement which required a single DOF 
in the final stage was performed. 

Control equations for knee joint: PHYSIOTHERABOT can perform knee 

flexion-extension movement and related exercises. One DOF is 

sufficient for this movement and exercises are performed by link 2. 

The reductor connected to the motor actuating link 2 has 100:1 reduc- 

tion ratio. Therefore, the external torque values (gravity, inertia, and 


Table 5 Control methods according to exercise types for PHYSIOTHERABOT. 





Exercise type Control method 

Passive PID control 

Active assistive PID control and impedance control 
Isometric exercise Impedance control and torque control 
Isotonic exercise Impedance control 

Isokinetic Impedance control and torque control 


Robotherapy Impedance control and PID control 





Impedance control applications in therapeutic exercise robots 427 





external force) are divided into 100. Using Eq. (18), the impedance 
control rule for link 2 can be obtained as follows: 











0.01b,. ; 0.01L 
T2 =Torav2 — ByO. + KO.) | + = — 19] 0.01 Fox, 91 
2 = Tyrav2 Tom | 19. + Ka.) ae o| (91) 
The PID position control rule for the one-DOF link 2 is given in the 
following: 
dO. 
772 = K,20.2 Pts Kien + Kine 6.2 dt + T grav2 (92) 


where Kyo, Kaer2, and Kin are proportional, derivative, and integral gains, 
respectively. 
Control equations for hip joint! PHYSIOTHERABOT can perform hip 
flexion-extension and abduction-adduction movements and related 
exercises. Description of position-based impedance control and position 
control techniques used in the performing of these movements are given 
in this section. 


CS hy ~~ Me 'S.4 = MJ,' Mz" (Bul, ae Kaye) + (Mj,'M;' = ex 
0, T xl hn My, Mi 
q = a tS > Tx => > hn = ? M= 
A2 T2 x2 hn2 Ma, M22 


All parameters in Eq. (93) are calculated in the previous sections. When the 
system starts to move, the force and position data is constantly updated and 
the motor torques that drive the PHYSIOTHERABOT are calculated in 
real time and the system performs desired movement. 

The PID position control rule for hip flexion-extension is given in the 
following equation: 


m1) _ {Kor 9 || Me 4 | Kinet 0 
72 O Kyo} | Oe 0  Kin2 


O1 edt ; 
| sg < es 0 | | 4 bea 
|e 0 Kéer2 | [926 Tgrav2 


(94) 
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The hip abduction-adduction movement is a one-DOF movement 
performed by the motor located at the base. This movement is performed 
by link 0. The abduction-adduction movement in the system is modeled 
for passive exercises. Therefore, as the movement requires only position 
control, it is sufficient to use the PID control method given in the follow- 
ing equation: 


d0. 
To = Kyo eo + Kio + Kino [0 dt (95) 


6.2 PHYSIOTHERABOT/w1 


Among the robots developed for rehabilitation purposes, those for the upper 

limb are much more than those for the lower limb. The reason for this is that 

people use their upper limbs more than their lower limbs to maintain their 

daily life activities. PHYSIOTHERABOT/w1, developed for the rehabil- 

itation of upper limbs, has the following features: 

- performs passive and active therapeutic exercises for wrist and forearm 
rehabilitation 

- has three DOF 

- portable and suitable for hospital and home use 

- has user friendly interface 

- obtains and stores patient data 

For detailed information and experimental results of PHYSIOTHERABOT/ 

w1, please refer to Akdogan et al. (2018). 

PHYSIOTHERABOT/w1 consists of a physiotherapist, patient, robot 
manipulator, and human-machine interface units that enable the communi- 
cation and control of the system. The physiotherapist enters the exercise data 
via the user interface. According to this data, the position and force trajec- 
tories are created according to the type of exercise chosen. This information 
is converted to torque data by the human-machine interface and sent to the 
robot manipulator. The human-machine interface includes a conventional 
hybrid impedance controller. The information from the position and force 
sensors on the robot manipulator are included in the control loop as feed- 
back information. The robotic manipulator allows the patient to perform 
exercise movements in the appropriate position and forces. 


6.2.1 Human-machine interface 
Human-machine interface (HMI) has four different units. These are main 
controller and GUI, data base, rule base, and hybrid impedance controller. 
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Main controller manages whole system. It is the main control unit of the 
HMI. The database stores patient information and exercises trajectory data. 
The rule base consists impedance parameters values with respect to exercise 
types. Using GUI, user can enter patient individual information and exercise 
data such as repetition number, duration, movement type, and resistance 
level. Hybrid impedance controller generates related torque value to control 
robot manipulator. 


6.2.2 Electronics hardware 

The electronics hardware block diagram of the system is shown in Fig. 14. 
There are three actuators in the system. Position information is received via 
encoders mounted on the motors. The ATI Nano25 (six axes force/torque 
sensor) is used for the force measurements. National Instruments analog 
input (NI PCI-6225), analog output (NI PCI-6703), and encoder cards 
(NI PCI-6601) were used for data acquisition. EMG signals belonging to 
the patient are also recorded in the system. However, it is not used as a feed- 
back element in the control cycle. At this point, the applications where the 
EMG participates in the control cycle are highly significant. 


6.2.3 Robot manipulator 

The robot manipulator made of 7000 series aluminum material has three 
rotational axes. With these axes, flexion-extension, ulnar-radial deviation, 
and pronation-supination movements are performed. The general structure 
of the robot manipulator can be seen from Fig. 15. 
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Fig. 14 Electronics hardware of the PHYSIOTHERABOT/w1. 
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Fig. 15 The general structure of the PHYSIOTHERABOT/w1. 


The patient’s arm is placed on the armrest. The patient’s hand is placed 
between the bars in the handle. With the force sensor located just below the 
handle, the force and torque values that are applied by the patient are mea- 
sured. With this sensor which can measure in six axes (three for force and 
three for torque), the force is measured during flexion-extension and 
ulnar-radial deviation movements, and the torque values are measured 
during pronation-supination movements. As shown in Fig. 15, there are 
mechanical limitations for safety in each axis. By means of the pins placed 
in these limitations, the ROM of the joints can be limited to the desired 
values. 


6.2.4 Kinematic and dynamic analysis 

The kinematic and dynamic analysis of a robotic system is important for 
robot control. When performing kinematic and dynamic analysis of robots, 
classical manual calculation techniques can be used. However, as the DOF of 
the robot increases, these calculations become more complicated. For this 
reason, for three-DOF PHYSIOTHERABOT/w1, the analysis programs 
that can calculate the parameters related to the system model were used. 
Fig. 16 shows the axes of the robot manipulator for kinematic analysis. 
The Denavit-Hartenberg parameters according to the axes of the robot 
manipulator shown in Fig. 16 are given in Table 6. 
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Fig. 16 The robot manipulator axes. 


Table 6 Denavit-Hartenberg parameters. 





Link qj Qj d; 0; 
1 0 90 degrees 0 nN 
2 0 90 degrees 0 90 degrees + qo 
3 ly 0 —h 93 





In Table 6, ; = 75 x 10° (m) and I, = 30 x 10-° (m). In this case, the 
transformation matrices are as follows: 
| (96) 


Ops 
T; = 


(97) 


cos(q1) —sin(q3) 0 1,cos(q3) 
>» _ | sin(qi) cos(q3) O ksin(qs) 
ae 0 0 1 -—-b (98) 
0 0 0 1 
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The drawings of the manipulator were made by the solid modeling 
program. The link parameters obtained from these drawings are given in 
Table 7. 

The dynamic equations of the system were obtained through the 
Robotics Toolbox which was programmed by Peter Corke. First, the infor- 
mation in Table 7 and Denavit-Hartenberg parameters (Table 6) is entered 
into the MATLAB program. Then the information entered in the program 
is combined to create the robot model. Finally, the dynamic parameters of 
the robot are obtained. 

















syms ql q2 q3 real % Angle variables 

syms dq1 dq2 dq3 real % Angular velocity variables 
M = robot.inertia[(q1 q2 q3)| % M matrix 

C = robot.coriolis[(q1 q2 q3)], [(dq1 dq2 dq3)] % C matrix 

G = robot.gravload|(q1 q2 q3)] % G matrix 





6.2.5 Hybrid impedance control of the PHYSIOTHERABOT/w1 

In the developed system, position control in the ROM of the robot manip- 
ulator is needed to model some exercises requiring position control such as 
passive and active-assistive exercises. However, due to contact with the 
patient and resistance to some exercises, the force control is needed. Because 
the system requires both position and force control, the hybrid impedance 
control method, which allows both position and force control within a sin- 
gle control rule, was used. Thus, with a single control rule, all therapeutic 
exercises could be modeled. The detailed information about hybrid imped- 
ance control is given in Section 4.1.4. The hybrid impedance control mode 
used in accordance with exercise types is given in Table 8. 


Hybrid impedance parameters selection according to exercise types 

There are four different levels for each type of exercises: low, medium, 
high, and very high. Thus, it becomes possible to perform exercises with 
patients having different muscular activation levels and to increase the 
efficiency of the exercises by incrementing the level as the patient progresses. 
The desired impedance parameters for these four levels are, respectively, 
given as follows: 


Table 7 Mechanical parameters of links. 
Link 1 


Link 2 


Link 3 





Mass (kg) 2.228 kg 
Center of mass (mm) 


0.0012 0.0414 
—0.0060 0.0119 


[6.96 —113.55 —82.67] 
Inertia matrix (kg m’) 0.0732 0.0012 —0.0060 


0.0119 
0.0462 


1.101 


[1.96 —83.72 —100.13] 


0.0170 
0.00005 
—0.00025 


0.00005 —0.000250 


0.0091 
0.0051 


0.0051 
0.0083 


0.374 


[—11.72 0 7.93] 


0.0006 0 
0 0.0008 
0.0001 0 


0.0001 
0 
0.0003 








SJOQOI 9S|D1aXe DIJNedesay} ul SUO!edI\dde jo1WUOD BdUePedy| 


eer 
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Table 8 Hybrid impedance control modes according to the exercise types for the 
PHYSIOTHERABOT/w1. 








Exercise type Hybrid impedance control mode 

Passive Position based (s = 1) 

Active assistive Hybrid (position (s = 1) + force (s = 0)) 
Isometric exercise Force based (s = 0) 

Isotonic exercise Force based (s = 0) 

Isokinetic Force based (s = 0) 

(Desired mass) ma € { 1.25, 2.50, 5.00, 7.50 } (kg) 
(Desired linear damping) ba € { 10, 20, 40, 80 } (Ns/m) 
(Desired spring) ka € { 100, 200, 400, 800 } (N/m) 
(Desired inertia) mg € { 0.0125, 0.0250, 0.0500, 0.0750} (kg m7) 
(Desired rotational damping) 6, € { 0.1, 0.2, 0.4, 0.8 } (N ms/rad) 
(Desired rotational spring) ka Ee {1, 2,4, 8} (N m/rad) 


There are additional parameters to hold the robotic arm in a fixed position: 


m, = 22.5, b, = 240, k, = 2400, m, = 0.225, bp = 2.4, and Rn = 24. 

The impedance parameters Mj, By, Ky, and S are diagonal matrices for 
which the first three entries are related to the translational movement of the 
end effector on x9, yo, and Zp axes and the last three entries are related to the 
rotational movement of the end effector around xo, yo, and Zo, respectively. 
For example, in order to prevent the end effector move on xp axis, the first 
entries of the impedance parameters Mj, By, and Kare selected as m, bj, and 
k;. The first entry of the switching matrix S as position-based impedance 
control (s = 1), and the desired position for this axis is 0 degree. 

Flexion-extension: During the flexion-extension movement, the origin of 
the coordinate system of the end effector moves in the yo and Zo axes and 
rotates about the xo axis (see Fig. 16). As a result, impedance parameters 
with corresponding axes are selected as the desired impedance parameters 
whereas the others are selected as the hold impedance parameters to avoid 
possible radial-ulnar deviation and pronation-supination movements. 


Mj = diag[100, m, m, m, m, 1] 

B, =diag[1000, b, b, b, b, 10] 
K, =diag[10,000, k, k, k, k, 100] 
5S Sdaell, $45, 1y 1] 
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The operator diag[x1, x2, ..., x;,| denotes a block diagonal matrix whose 

elements on the main block diagonal are x1, x2, ..., X,. The parameters s 

are chosen according to the exercise types which are listed in Table 8. 
Radial-ulnar deviation: During the flexion-extension movement, the ori- 
gin of the coordinate system of the end effector moves in the xo and Zo 
axes and rotates about the yo axis. 


Mj = diag|m, 100, m, 1, m, 1] 

B, =diag[b, 1000, b, 10, b, 10] 

Ky =diag[k, 10,000, k, 100, k, 100] 
S =aisgly 1, 31,4, 4] 


Pronation-supination: During pronation-supination movement, end effec- 
tor only rotates about the zo axis. 


M; = diag{100, 100, 100, 1, 1, m] 

By =diag[1000, 1000, 1000, 10, 10, 6] 

Kj =diag[10,000, 10,000, 10,000, 100, 100, ] 
S =diael1, 1, 1, 1,1, 5] 


6.3 DIAGNOBOT 


DIAGNOBOT is a robotic system developed for upper-limb rehabilitation. 
It has an intelligent control structure to perform diagnosis and therapy. It can 
perform flexion-extension and ulnar-radial deviation for the wrist and 
pronation-supination for the forearm movements. It is able to perform pas- 
sive, active-assistive, stretching, isometric, isotonic, and resistive exercises. 
The PID and position-based impedance control were used for position- 
based exercises. The force-based impedance control and the angle- 
dependent impedance control were used for force-based exercises. For 
detailed information about the DIAGNOBOT, please refer to Aktan and 
Akdogan (2018) and Aktan (2018). 


6.3.1 Robot manipulator 

The general structure is shown in Fig. 17. The patient’s arm is placed in the 
arm clamping mechanism actuated by the stepper motor. The manipulators 
were placed on the rotary table. The manipulators can be adjusted according 
to the length of the limbs. All manipulators are actuated by servo motor. 
Joint force and torque values are measured by the force and torque sensors. 
The patient’s hand is placed between the bars of the handle. In the 
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Fig. 17 General structure of the DIAGNOBOT. 


movement of the flexion-extension and ulnar-radial deviation, the patient’s 
arm has to be fastened by the arm clamping mechanism. 


6.3.2 Electronics hardware 

The block diagram of the electronics hardware is shown in Fig. 18. The 
physiotherapist is the main user of the system. He enters all the information 
relevant to the therapy. There are two PCs in the system: The Main PC is 
used to run the algorithms and the Target PC consists of DAQ cards. There 
is a Raspberry Pi ver.3 running the games for the isometric, isotonic, and 
resistive exercises. The algorithms were developed in MATLAB R2017a. 
The Simulink Real Time was used for the real-time prototyping. The 
UDP and TCP/IP protocol used for the communication between hard- 
ware. There are three servo motors (Maxon EC-Max 30) with the 103:1 
reduction ratio and 500 pulse/rev encoders. There are also three servo 
motor drivers (Maxon EPOS 2 50/5) in the system. There are two force 
sensors (Burster 8523-200) and one torque sensor (Burster 8627-5710) to 
measure the torque and force applied by the patient. The force sensors were 
used in flexion-extension and ulnar-radial deviation units. The torque sen- 
sor was used in pronation-supination unit. The measurement ranges of each 
sensor are given in Table 9. 
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Fig. 18 Electronics hardware of the DIAGNOBOT. 
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Table 9 The measurement ranges of the sensors. 








Sensors Range 
Torque sensor +10 Nm 
Force sensors +200 N 
Force sensor for measurement of the grasping force 50 kg 





In the system, for the encoder input and analog inputs/outputs, 
Measurement Computing PCI QUAD04, NI PCI-6024E, and NI PCI- 
6040E DAQ cards are used, respectively. 


6.3.3 Dynamic analysis 
In this section, the dynamic equations are obtained and dynamic para- 
meters of the system are calculated by using the experimental robot identi- 
fication using optimized periodic trajectories method developed by Swevers 
et al. (1996). 

The manipulator dynamic equation for a single robot link is expressed by 
the following equation: 


t= M(q)q + gmr,sin (q) + gmr,cos(q) + f.(4) +f sign(q) (99) 


where 1, and r, are the y and x position of the center of mass, respectively. 
The f, and f, are the viscous and Coulomb friction coefficients, respectively. 

The inverse dynamics of Eq. (99) can be expressed by the following 
equation: 


r =[q g-sin(q) g-cos(q) 4 sign(q)]- | mr 


=$(4.4.9) Pp 


In this equation, the robot position, velocity, and acceleration are known. 
The vector p contains unknown parameters. If at least six different vector 
and t values corresponding to vector ¢@ are known, vector p can be calcu- 
lated. This is called the parameter estimation method (Swevers et al., 1996). 

However, there are errors in the measurement of the velocity and the 
acceleration of the link and the motor torque. Therefore, more than six 
measurements were made and it is ensured that the robot manipulator 
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follows a predetermined trajectory through a PID controller. Consider we 


have i € 1, ..., M observations data, we can solve the equation of Y= W.: p: 
$4.40 a 

w= One ,Y= 2 (100) 
o(q".q"". 4") a 


The condition number of the matrix W represents how close the solution to 
the nonlinear differential equation is. To obtain the optimal trajectory, the 
optimal solution was found to minimize the condition number of the matrix 
W. The fmincon function of the MATLAB was used for the solution. Let us 
represent the trajectories as a finite Fourier series: 


qa). = Soin (alt) A cos (alt) + qo (101) 
l=] rl yl 
N 
qe) = S “aicos (wylt) + bj cos (aylt) (102) 
=1 
N 
G(t) =) — —aaylsin (welt) + bywpl cos (cpl) (103) 


i=] 


where @yis the fundamental pulsation of the Fourier series, a; and b; are the 
coefficients, Nis the number of harmonics, and qo is the robot configuration 
around which the robot excitation occurs. Boundary conditions for posi- 
tion, velocity, and acceleration can be given in obtaining the optimal trajec- 
tory. These boundary conditions are expressed as follows: 


5 =arg mincond(6, oy) 
dmin S q(t) < dmax 

—4max S A(t) S max 

—Gmax S A(t) S max 
where 6 is the vector containing Fourier coefficients. 6* is the optimal 6 
which minimizes the condition number of matrix W. In the optimization, 
w= 0.1, N= 5, qmin = —90 degrees, and qmax = 90 degrees were selected. 
With a PID controller, the robot manipulator for each unit is followed the 
optimal trajectory and the q,q,q values are saved and the vector W is 
obtained. The torque values applied by the servo motor during the follow- 
ing of the optimal trajectory are also saved and the Y vector is obtained. The 
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Table 10 Estimated parameters for each manipulator. 





Parameters Pro-Sup Fle-Eks Uln-Rad 

M 0.0277 0.0091 0.0177 kg m?* 

My 0.0082 0.2501 0.1878 kgm 

Mty 0.0182 0.4811 0.2733 kgm 

te 0.0733 0.2433 0.3741 N m s/rad 
ft 0.1333 0.0766 0.0821 Nm 





Table 11 Control methods according to exercise types for the DIAGNOBOT. 





Exercise type Control method 

Passive PID control 

Active assistive PID and position-based impedance control 

Isometric exercise PID control 

Isotonic exercise Force-based and angle-dependent impedance control 
Resistive Force-based and angle-dependent impedance control 





dynamic parameters of the system identified by using the least square esti- 
mation method in the following: 


p=(W' w) 'WTy 


The obtained dynamic parameters are given in Table 10. 


6.3.4 Control of the DIAGNOBOT 
Therapeutic exercises require force and position control. In the 
DIAGNOBOT, PID and position-based impedance control were used 
for position-based exercises. The force-based impedance control and the 
angle-dependent impedance control were used for force-based exercises. 
Exercise types and control methods are given in Table 11. 

The control equations for DIAGNOBOT are explained in Section 4. 
For position-based exercises (Eq. 9) and general PID control equation are 
used. For force-based exercises (Eqs. 22, 28) are used. 





7 Discussion 


Impedance control is the most effective control method in human- 
robot interactive systems. Especially rehabilitation robots are very suitable 
for this control method in terms of patient-robot interaction. Therefore, var- 
ious impedance control methods were used in the research studies in the field 
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of rehabilitation robotics. There are four different fundamental impedance 
control structures: position based, force based, hybrid, and variable. 

Therapeutic exercises consist of passive, active-assistive, and resistive 
exercises. These types of exercises require position and force control in 
terms of robotic. Therefore, these therapeutic exercises can be made by 
a robot to the patient by using the impedance control. Robotic rehabili- 
tation has many advantages. These advantages have also been proven by 
clinical trials. 

This chapter describes in detail how impedance control and therapeutic exer- 
cise modeling can be performed in three different therapeutic exercise robots 
previously developed by the authors. The PHYSIOTHERABOT is a three- 
DOF robot for lower-limb rehabilitation. The PHYSIOTHERABOT/w1 is 
a three-DOF robot for upper-limb rehabilitation. The DIAGNOBOT is an 
advanced version of the PHYSIOTHERABOT/w1 and contains differences 
in terms of mechanical and control. With these systems, therapeutic exercises 
were successfully modeled. However, modeling of manual exercises is still an 
important research topic. For this purpose, the use of artificial intelligence tech- 
niques combined with conventional control techniques can solve the problem. 
On the other hand, complex mechanical designs are needed to model rotational 
exercise movements, especially in lower limbs. For these movements, it is 
extremely important to ensure safety in robotic rehabilitation. 





8 Conclusion 


The studies on the use of impedance control in rehabilitation robots 
are ongoing. At this point, especially the selection of the impedance param- 
eters and updating them according to the exercise performance of the patient 
are important research topics. The powerful control structures are needed to 
model physiotherapist movements precisely. In addition, studies are needed 
to determine the mechanical properties of manual exercises. This informa- 
tion can be used to design novel robotic systems which are able to perform 
more effective robotic rehabilitation. 
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1 Introduction 


Ina prescient talk in 1959, the late Nobel physicist Richard P. Feynman 
said, ““There’s Plenty of Room at the Bottom,” and proposed to make 
miniature machine apparatuses and use these apparatuses to make still smaller 
machine apparatuses and so on, all the way down to the atomic level. 
Feynman was very much clear about the possible medical applications of 
the new technology. He added: 


‘A friend of mine (Albert R. Hibbs) suggests a very interesting possibility for relatively 
small machines. He says that, although it is a very wild idea, it would be interesting 
in surgery if you could swallow the surgeon. You put the mechanical surgeon inside 
the blood vessel and it goes into the heart and looks around. It finds out which 
valve is the faulty one and takes a little knife and slices it out. Other small machines 
might be permanently incorporated in the body to assist some inadequately 
functioning organ.” 


Later, in his subsequent lecture in the same year, Feynman proposed the 
option of linking with biological cells and said, “We can manufacture an 
object that maneuvers at that level!” The vision of Feynman come to be 
a reality after the publishing ofa technical paper by Eric Drexler in which 
he suggested that it might be possible to build nanodevices from biological 
parts that could examine and repair the cells of a human being. The explo- 
ration was followed a decade later by Drexler’s technical book laying the 
foundations of molecular machines and molecular manufacturing systems 
(Drexler, 1986, 1992; Drexler et al., 1991) and subsequently supported 
by Freita’s technical books on medical nanorobotics (Freitas, 1999, 
2003, 2005). 
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In the earlier 1990s, very little scientific work was done on nanorobotics, 
and was mostly based on concept generation, architecture, and modeling. 
Since then, many research papers have been published on systematic com- 
putational and experimental studies on nanorobotics. Nowadays, the field of 
nanorobotics keeps expanding and many scientists and researchers in their 
laboratories all over the world are focusing their activities on it. Nan- 
orobotics became known to the public via science fiction movies, television, 
and books. In 1966, Isaac Asimov published a book entitled Fantastic Voyage, 
in which he described a minuscule submarine capable of moving through 
the human bloodstream (Asimov, 1966), while in 2002, in the very popular 
book, Prey, Michael Crichton introduced a swarm of intelligent nanorobots 
that threaten humankind (Crichton, 2002). Even though the concept of 
nanorobotics being described in this book is not at all related with the actual 
theory of nanorobots, it helped to generate public interest, which is impor- 
tant for the future growth of the field. Nanorobotics is a comparatively new 
field that grew out of the merging of robotics and nanotechnology during 
the late 1990s and early 2000s. 

The term nanorobot was being used by the scientific community in the 
broadest possible way in the late 1990s, because this term included any type 
of active structure capable of anyone of the following, or any of them in com- 
bination: actuation, sensing, manipulation, propulsion, signaling, information 
processing, intelligence, and swarm behavior at the nanoscale. The term 
nanorobot includes large-scale manipulators with nanoscale precision accu- 
racy and manipulation capabilities and micro-scale robotic devices with at 
least one nanoscale component (Weir et al., 2005). Nanorobots are basically 
theoretical microscopic devices built on nanometer dimensions (10-” m). 
When nanorobotics has fully realized its potential from the current theoretical 
stage, nanorobots will work at atomic, molecular, and cellular level to per- 
form tasks in both medical and industrial fields. This came as a natural evo- 
lution of the micro-robotics field that grew rapidly in the 1990s and of 
the nanotechnology field that exploded in the 2000s. Some of the most prim- 
itive appearances of the term occur in 1998 in the paper by Requicha et al. 
that focused on nanorobotic assembly (Requicha et al., 1998); Sitti and 
Hashimoto’s paper on tele-nanorobotics (Sitti et al., 1998); and in 1999, 
Freitas’ book on nanomedicine, where one can find a nice historical presen- 
tation of the nanorobotic concept for medical applications (Freitas, 1999). 
Prior to 1998, the term nanorobot had been clearly described by several 
researchers and was referred to as a “molecular machine,” “nanomachine,” 
or “cell repair machine” (Wowk, 1988; Dewdney, 1988). 
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This chapter emphasizes developments in the evolving domain of nan- 
orobotics in medicine, especially on the design and application of cancer and 
cerebral aneurysm. 





2 Design of nanorobotic systems for cancer therapy 


Important parameters used for medical nanorobotic architecture and 
its control activation, along with essential technological background for 
advance manufacturing hardware for molecular machines are described 
below. 


2.1 Mechanized technology 


In manufacturing technology, complementary metal oxide semiconductor- 
very large scale integration (CMOS-VLSI) and verification hardware 
description language (VHDL) are playing an important role. The CMOS 
industry is guiding a pathway for assembly processes needed to manufacture 
components required to enable nanorobots, whereas to confirm the designs 
and to achieve a fruitful implementation, VHDL is being utilized in the inte- 
grated circuit manufacturing industry. 


2.2 Chemical sensor 


In the past decade, production of silicon-based chemical sensor and motion 
sensor arrays with the use of two-level system architecture hierarchy has 
been successfully achieved. These sensors are in widespread use from auto- 
motive to chemical industries for detection of air, water, element, and pat- 
tern recognition through embedded software programming and biomedical 
uses. Similarly the use of nanotechnology is also groom in this field as nano- 
wires which decreased the estimated cost of energy demanded for data trans- 
fer and circuit operation by up to 60%. The CMOS-based biosensors using 
nanowires as material for circuit assembly can achieve superior efficiency for 
applications in detecting chemical changes, thus enabling medical treatment 
with increased precision and effectiveness. CMOS devices of 90 and 45 nm 
represent breakthrough technology devices that are being applied in 
manufacturing of nanorobots. Discovery or development of new materials 
such as strained channel with relaxed SiGe layer can reduce self-heating and 
improve the performance of nanorobots. In advance manufacturing tech- 
niques, silicon on insulator (SOT) technology has also been used to assemble 
high-performance logic sub 90 nm circuits. Circuit design methods to 
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resolve bipolar effects and hysteretic variations based on SOI structures have 
been verified positively. In addition, chemical nanosensors can be implanted 
in nanorobots to monitor epithelial cadherin gradients. E-cadherin (or 
Cadherin-1, or CAM 120/80, or Uvomorulin) is a protein in the human 
body, encoded by the CDH1 (tumor suppressor) gene, which is designated 
as cluster of differentiation 324. Evolution of cancer and metastasis 1s directly 
proportional of loss of E-cadherin, which means E-cadherin down regula- 
tion decreases the strength of cellular adhesion within a tissue, causing an 
increase in cellular motility, which allows cancer cells to cross the basement 
membrane and invade surrounding tissues. E-cadherin is also used by 
pathologists to diagnose different kinds of breast cancer. When compared 
with invasive ductal carcinoma, E-cadherin expression is markedly reduced 
or absent in the great majority of invasive lobular carcinomas when studied 
by immunohistochemistry. 

Nanorobots programmed for these tasks can perform detailed screening 
of the whole body of the patient. In this biomedical nanorobotic architec- 
ture, cellphones are used to retrieve patient information. A cellular applica- 
tion uses electromagnetic waves to command and detect the current status of 
nanorobots inside the patient’s body. Contemporary advancement in 
FinFETs, double-gates, and 3D circuit technologies is capable of 
accomplishing surprising outcomes, which are expected to develop further. 


2.3 Power supply 


Active telemetry and power supply is the most effective and secure method 
of sustained energy supply for nanorobots in operation using CMOS. A sim- 
ilar procedure is also suitable for digital bit encoded data transfer from inside 
the human body. 

It can be understood that nanocircuits with resonant electric properties 
can operate as a chip providing electromagnetic energy and supplying 
1.7 mA at 3.3 V for power, allowing the operation of many tasks with very 
few or no power losses during the transmission. By utilizing a techniques 
that is widely used for commercial applications of radio frequency identifi- 
cation devices (RFID), with the use of inductive coupling, RF-based 
telemetry procedures have demonstrated encouraging results in patient 
monitoring and power transmission. In this procedure, the energy savings 
can be in the ranges of ~1 pW when the nanorobot is in inactive modes, 
and gets activated when signal patterns require it to do so. Some general 
nanorobotic tasks may require the device only to utilize low amounts of 
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power once it has been strategically activated, for example, only ~1 mW RF 
signal required for communication. The easiest way to implement this archi- 
tecture is by cellphone, which should be uploaded with the control software 
that includes the communication and energy transfer protocols, gaining both 
energy and data transfer capabilities. 


2.4 Data transmission 


The implanted devices and integrated sensors inside the human body to 
transmit health data of patients will provide exceptional advantage in con- 
stant medical monitoring. RFID chips have been developed as an integrated 
circuit device for medicine, and RFID for in vivo data collection and trans- 
mission has been successfully tested for electroencephalograms. Many 
researchers and scientists are working on single chip RFID CMOS-based 
sensors because CMOS with submicron SoC design may be used for very 
low power consumption in nanorobotic communication over longer dis- 
tances through acoustic sensors. Nanorobots’ active sonar communication 
frequencies may reach up to 20 pW @8 Hz at resonance rates with 3 V sup- 
ply. In molecular machine architectures, to implant an embedded antenna 
for nanorobot RF communication with 200 nm size, a small loop planar 
device is adopted as an electromagnetic pick-up. It also has a good matching 
on low noise amplifier and is developed on gold nanocrystal with 1.4 nm° 
CMOS and nanoelectronics circuit technologies. Frequencies in the range 
of 1-20 MHz can be fruitfully used in biomedical applications without any 
damage to the device. 





3 System implementation 


Real-time 3D prototyping and simulation tools have significant benefits 
in nanotechnological developments because these tools have helped the semi- 
conductor industry to attain faster VLSI developments. Simulation can antic- 
ipate the performance and provide support in device design, manufacturing, 
nanomechatronics control design, and hardware implementation. The simu- 
lation includes the nanorobot control design (NCD) software for nanorobot 
sensing and actuation, whereas nanorobot architectures include integrated 
nanoelectronics. The nanorobot architecture involves the use of cellphones 
for the early diagnosis of E-cadherin levels for smart chemotherapy drug deliv- 
ery and in new tumor detection for cancer treatments. Nanorobots use an 
RFID CMOS transponder system for in vivo positioning using well- 
established communication protocols that allow tracking information about 


450 Ramna Tripathi et al. 





the nanorobot position and this information will help doctors in detecting tiny 
malignant tissues in the initial stages of development. The exterior of 
nanorobots is made up of diamondoid material, to which may be attached 
an artificial glycocalyx surface. The exterior material minimizes fibrinogen 
(and other blood proteins) adsorption and bioactivity, ensuring sufficient bio- 
compatibility to avoid immune system attack. Various types of molecules have 
been distinguished by a series of chemotactic biosensors whose binding sites 
have a different affinity for each kind of molecule. These sensors are also capa- 
ble of detecting obstacles that might require new trajectory planning for 
nanorobots. Nanorobots with sensory capabilities are able to detect and iden- 
tify changes of E-cadherin proteins gradients beyond permissible levels, which 
guide the nanorobots in detecting tumors even at early stages of cancer. There 
could be a variety of such sensors, for instance, chemical detection can be very 
selective for identifying various types of cells by their markers. In acoustic 
sensing, different frequencies are detected, which have different wavelengths 
depending on object sizes of attention. 





4 Chemical signals inside the body 


Depending on the requirement of communication in liquid 
workspaces, acoustic, light, RF and chemical signals are considered as prob- 
able alternatives for communication and data transmission. E-cadherin is a 
chemical signaling, which act as a transmission media between nanorobots. 
Chemical signals and their interaction with the bloodstream are a very 
important aspect to manage the application of nanorobots in cancer therapy. 
The signal sensing of nanorobots for simulated architecture in detecting gra- 
dient changes on E-cadherin signals are examined. 

In order to improve response and bio sensing capabilities, nanorobots 
maintain positions near the vessel wall instead of floating throughout the 
vessel in the volume flow. The vein wall is modeled with a grid texture 
to enable better depth and distance perception in the 3D workspace. 
Another significant choice in chemical signaling is the measurement of time 
and detection of threshold at which the signal is considered to be received. 
Because of background concentration, some detection occurs even in the 
absence of the target signal. With threshold, diffusive capture rate (a) is used, 
for a sphere of radius (R) in a region with concentration as (the concentra- 
tion for other shapes such as cylinders is about the same): 


a=4n2DRC 
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With autonomous random motions for the molecules, detection over a time 
interval (Af) is a Poisson process with mean value aAt. Table 1 shows the 
different parameters with chemical signals that one can use to find out the 
variables related with this concept. Scientists have discovered that, with 
the plaque on the vessel wall, fluid velocity near the target is lower than 
the average velocity. 

When the nanorobot first detects a tumor for medical treatment, the 
nanorobot is programmed to attach on the tumor cell. The nanorobotic 
architecture is designed to send wireless communication about the accu- 
rate position of the tumor to the doctors. Then a predefined number of 
other nanorobots to support in perceptive chemotherapeutic action with 
precise drug delivery above the tumor are called for by sending signals. In a 
similar manner to quorum sensing in bacteria, it starts from monitoring the 
concentration of signals, chemical substances for near communication will 
attract or repeal nanorobots, and also estimates the number of nanorobots 
at the target. Due to this, nanorobots stop attracting other nanorobots 
when a sufficient number of nanorobots have responded to the initial sig- 
nal. The amount of nanorobots can be changed depending on the stage of 
cancer and the tumor size, and may be defined by the oncologist based on 
the information received from the nanorobots through RF electromag- 
netic waves. The nanorobots at the plaque emit a different signal than 
others not already at the target, which is interpreted as an indication that 
others no longer need to respond. This mechanism allows them to be free 
to further search for other malignant tissues inside the body. Nanorobots 
will empower drug delivery and are also loaded with therapeutic 


Table 1 Chemical signal and parameters. 
Chemical signals 











Production rate (Q) 10* molecules/s 

Diffusion coefficient (D) 100 pm?/s 

Background concentration (C) 6 x 10~° molecules/(tm)? 
Parameters Values 

Average fluid velocity (v) 1000 prm/s 

Vessel diameter (d) 20 pm 

Workspace length (L) 50 pm 

Density of cells 2.5 x 107° cell/(um)* 


Nanorobot 2 um? 
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chemicals, preventing the cancer from spreading further. The following 

control mechanisms are being considered: 

¢ Random: Nanorobots moving inactively with the fluid reaching the tar- 
get only if they bump into it due to Brownian motion. 

¢ Follow gradient. Nanorobots monitor concentration intensity of 
E-cadherin signals when detected; they measure and follow the gradient 
until they reach the target. If the gradient estimate finds no additional 
signal in 50 ms, the nanorobot considers the signal to be a false positive 
signal and continues flowing with the fluid. 

¢ Follow gradient with attractant: In addition to the previous mechanism, 
nanorobots arriving at the target release a different chemical signal, 
which is used by others to improve their ability to find the target. This 
mechanism involving peer-to-peer communication amongst the 
nanorobots is highly pertinent for improving nanorobotic performance. 





5 Simulator results 


Consider a fluid moving with uniform velocity (v) in the positive x 
axis direction. It contains a point source of chemical production rate (Q) 
in molecules per second. The diffusion coefficient is represented by D, 
and the diffusion equation is: 


DV*C = vdC/dx 


With the boundary conditions ofa steady point source at the origin and dis- 


tance to the chemical signal source (r = / x + y° + 2°) and no net flux 
across the boundary plane (y = 0), determines the steady-state concentration 
(C), i.e., time during which concentration (molecules/ jim’) remains stable 
or consistent, at point (x, y, 2) 1s: 


C(x, y, 2) = (Q/2aDr)e "9 /2P 


In nanorobotic behavior the fluid flow pushes the concentration of diffusing 
signal downstream. Subsequently, a nanorobot at more than a few microns 
away from the source won’t detect the signal while it is still relatively near 
the source. 

By taking the parameters from Table 1, one can detect an average higher 
signal concentration within about 10 ms when nanorobots are close enough. 
Thus, keeping their motion near the vessel wall, the signal detection happens 
after nanorobots have moved around 10 pm past the source. Thus, nearly 
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five nanorobots per second arrive at the tumor cell in the small venule, 
which is one among many types of vessels present in the human body. 

A design trade-off for chemical signals the nanorobots could release is 
designed by the equation C(x, y, 2) = (Q/2aDne ""—””?P. Additional 
signals will use other molecules, which could, by design, have a different 
diffusion coefficient to use instead of the diffusion coefficient associated with 
the chemical from the target. From this equation, the effect of the fluid 
motion becomes significant at distances; this means that faster diffusion 
results in lower concentrations, demanding more time for other nanorobots 
to determine gradients. In future, ifthe signals are increasing in a steady, con- 
stant, and progressive manner, then chemical diffusion could be more effi- 
cient for nanorobotic communication. The nanorobots strike the target, if 
passing inside the human body, with a speed of nearly 0.1 fm. The 
nanorobots crossing within a few microns often detect the signal, which 
spreads a bit further upstream and away from the single tumor due to the 
slow fluid motion near the venule’s wall and the cell’s motion. Nanorobots 
flowing closer to the wall also benefit from slower fluid motion near the 
walls by having more time to detect signals. An “attractant” signal with 
the same value of D as the original signal has been used. Each nanorobot 
can release at one-tenth the rate of the target over the time. Individual per- 
formance has been observed throughout a set of analyses obtained from the 
NCD software, in which nanorobots use chemical sensors as the communi- 
cation technique to interact dynamically in a 3D environment and to 
achieve a positive collective coordination. The virtual environment com- 
prised of a small venule vessel that contains nanorobots, red blood cells 
(RBCs), and a single tumor cell, which is the target area on the vessel wall. 
Here, the target area is overlapped by the RBCs. 

Table 2 provides a summary and comparison of the control techniques 
evaluated using the NCD simulator with the time required for 10 
nanorobots and 20 nanorobots to identify and reach the target. 

Each value is the mean of 30 repetitions in simulation, with standard 
deviation in parentheses. The error estimate for these mean values is 


Table 2 Nanorobots: times in seconds to reach the target. 


Control method Nanorobots (10) Nanorobots (20) 
Random motion 0.73 (0.18) 1.47 (0.28) 
Follow gradient 0.54 (0.17) 1.14 (0.24) 


Gradient with “attractant” 0.46 (0.13) 0.79 (0.14) 
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J 30 times smaller than the standard deviations listed here. For comparison, 
if every nanorobot passing through the vessel found the target, 20 
nanorobots would arrive at the target in about 0.2 s, which enables 
nanorobots to detect and follow gradient concentration and thus increases 
the probability for nanorobots to find the target. In comparison, with ran- 
dom motion, here the nanorobots depict better performance by 23%. For 
gradient with an “attractant,” the signals allow the nanorobots to find 
and reach the target in the 3D workspace 46% faster than that with 
random motion. The improvement in performance is remarkable in terms 
of response time, hence improving the chances of detecting and eliminating 
small tumors. 





6 Design of nanorobotic systems for cerebral aneurysm 
6.1 Nanorobot for intracranial therapy 


Considering the properties of nanorobots to navigate as blood borne 
devices, they can aid significant treatment processes of complex diseases 
in early diagnosis and smart drug delivery (Freitas, 2005; Couvreur et al., 
2006). Embedded technology plays an important role in nanorobotic 
application; through different embedded nanosensors, one can identify 
medical zones inside the human body. Various computational and 
numerical simulation techniques are being used that conclude various 
changes of chemical patterns for brain aneurysm. Various sensing meth- 
odologies are offered for nanorobots to identify harmful growth and 
level of difficulties in medicine, including specialized brain therapies 
(Leary et al., 2006; Gao et al., 2004). Nowadays, nanorobotic technology 
is used for treatment of patients from cerebral aneurysm, which solves all 
the problems. 


6.2 Nanorobot hardware architecture 


Usage of micro devices for medical treatments and instrumentation has 
investigated various important methods for aneurysm surgery (Ikeda 
et al., 2005; Roue, 2002). In a similar fashion to how the development of 
micro technology in the 1980s led to new tools for surgery, emerging nano- 
technologies will similarly facilitate further advancements in better diagnosis 
and new devices for medicine with the help of manufacturing of 
nanoelectronics (Rosner et al., 2002). 
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6.2.1 Manufacturing technology 

The capacity to assemble nanorobots has resulted from new methodologies 
used in fabrication and different types of transducers used. Various changes 
on temperature, chemicals in the bloodstream, and electromagnetic signa- 
ture effect are some of the key parameters in biomedical need. Nowadays, 
CMOS technology is used to manufacture components required to enable 
nanorobots. The combination of nanophotonics and nanotubes is enhancing 
the levels of resolution (Park et al., 2005a, b) to confirm the designs and to 
achieve a fruitful implementation; VHDL is being utilized in the integrated 
circuit manufacturing industry. 


6.2.2 Chemical sensor 
CMOS sensors using nanowires allow new medical applications, which 
conclude various chemical changes. Sensors with suspended arrays of nano- 
wires assembled into silicon circuits resolve the problem of self-heating and 
thermal coupling (Fung et al., 2004). In addition, advancements in SOI 
technology are being used to assemble high-performance logic (Park 
et al., 2005a, b). Approaches of circuit design to solve bipolar effect and hys- 
teretic variations problems, SOI structures have been confirmed (Bernstein 
et al., 2003). The best material to design CMOS IC nanosensors is carbon 
nanotube (Kishimoto et al., 1992). The protein nitric oxide synthase (NOS) 
offers positive or negative effects upon cells and tissues in cellular living pro- 
cesses. It has also been recognized that the correlations between higher levels 
of NOS and brain aneurysm have been established (Fukuda et al., 2000). 
The antibody used for medical nanorobots helps in identifying higher 
concentrations of proteins that couple NOS forms in the intracellular blood- 
stream (NOS 2007). Nanobiosensors provide a well-organized technique 
for nanorobots to identify the exact locations with existence of NOS, which 
is represented by gradients in the brain enzymes. 


6.2.3 Actuator 

A set of fullerene structures has been presented for nanoactuators (Crowley, 
2006). The use of CNTs as conductive structures permits electro-statically 
driven motions providing forces necessary for nano-manipulation. CNT 
self-assembly and SOI properties can collectively address CMOS high per- 
formance of design and manufacturing nanoelectronics and nanoactuators 
(Shi et al., 2006). In medical nanorobots, the use of CMOS as an actuator 
based on biological patterns and CNTs is adopted. In the similar fashion 
DNA can be used for coupling energy transfer (Schifferli et al., 2002a, b; 
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Ding et al., 2006) and proteins may serve as basis for ionic flux with electrical 
discharge ranges from 50 to 70 mV DC voltage gradients in cell membrane 
(Jenkner et al., 2004). An array format based on CNTs and CMOS tech- 
niques could be used to achieve nanomanipulators as an embedded system 
for integrating nanodevices of molecular machines (Zheng et al., 2005). Ion 
channels can be interfaced with electrochemical signals using sodium for the 
energy generation necessary for mechanical actuators’ operation (Jenkner 
et al., 2004). Actuators are programmed to perform different manipulations, 
which assists the nanorobot in an active interaction with the bloodstream 
inside the body. 


6.2.4 Power supply 

In nanorobots, the use CMOS technology for active telemetry and power 
supply is the best and most secure way to guarantee power supply. The same 
technique can also be used for bit encoded data transfer from inside the 
human body (Mohseni et al., 2005). Nanocircuits with tuned electrical 
properties can work as a chip, providing energy in electromagnetic form 
to supply at 1.7 mA at 3.3 V. This also permits such tasks with few or no 
transmission losses (Sauer et al., 2005). RF-based telemetry has shown com- 
mendable results in patient monitoring and power transmission with the use 
of inductive coupling (Eggers et al., 2000). 


6.2.5 Data transmission 

Nanorobot architecture includes a single chip RFID CMOS-based sensor 
(Ricciardi et al., 2003) Using sensor data transfer as well as read and write 
data is feasible. Therefore, nanorobot active sonar communication frequen- 
cies may reach up to 20 pW@8 Hz at resonance rates with 3 V supply 
(Horiuchi et al., 2004). For brain aneurysm, chemical nanosensors are 
embedded in nanorobots to monitor NOS levels. After the last set of events 
recorded in a pattern array, information can be reflected back by wave res- 
onance. The passive data transfer at ~4.5 kHz frequency with approximate 
22 ws delays are possible ranges for data communication. In molecular 
machine architecture, an antenna with 200 nm size for the nanorobot RF 
communication has been embedded. A small loop planar device is 
implemented as an electromagnetic pickup, having a good matching on 
low noise amplifier. The antenna is based on gold nanocrystal with 1.4 
nm°, CMOS, and nanoelectronics circuit technologies (Schifferli et al., 
2002a, b; Sauer et al., 2005). 
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6.3 Implementation and simulation results 


Nanorobots can be programmed to detect different levels of inducible nitric 
oxide synthase (iNOS) pattern signals using chemical sensors embedded 
nanoelectronics. The iNOS proteins serve as medical targets for detecting 
early stages of aneurysm development. 

In the NOS subgroups, while eNOS acts as a positive protein, the 
nNOS is linked to neurodegenerative diseases like Alzheimer’s and 
Parkinson’s. nNOS plays a distinct role on endothelial cell degenerative 
changes (Kishimoto et al., 1992). In special cases, nNOS could result in 
negative effects with nitrosative stress, accelerating intracranial aneurysm 
rupture. Nanorobots injected in the bloodstream have been used as mobile 
medical devices. Fig. 1, showing the medical 3D environment, contains 
clinical data based on key morphological parameters in patients with 
cerebral aneurysm. 

Integrated nanosensors, nanobioelectronics, and RF wireless communi- 
cations (Cavalcanti et al., 2007) are incorporated into the nanorobot model 
in order to inform changes of gradients for iNOS signals (Fukuda et al., 
2000), which assists the medical professional in deciding the treatment plan. 

The nanorobots are designed at dimensions of 2 Um, which allows them 
to operate easily inside the body. The nanorobot model comprises of IC 
nanoelectronics and the platform architecture can instead use cellphones 
for data transmission and coupling energy. Computations are performed 
by embedded nanosensors. They are programmed for sensing and detecting 
NOS concentrations in the bloodstream. Due to background compounds, 
some detection occurs even without the NOS concentrations specified as 
the aneurysm target. High precision and a fast response are required for 





Fig. 1 Aneurysm morphology—MCA, middle cerebral artery; BT, basilar trunk; BA, 
basilar artery. 
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biosensors. Additionally, false positives of NOS can often occur due to some 
positive functions of nitric oxide with semicarbazone (pNOS). Chemical 
detection in a complex and active environment is a vital aspect for 
nanorobots in the task of interacting within the human body. 

In the nanorobot architecture, the integrated system contains engines for 
orientation, drive, and sensing and control mechanisms. Core morphologic 
features related to brain aneurysm are taken for modeling the study of 
nanorobots sensing and interaction with blood fluid patterns in the 
deformed vessel. 

A critical issue on cerebral aneurysm is to detect and locate the vessel dila- 
tion. Nanorobots are required to track the aneurysm growth before a sub- 
arachnoid hemorrhage occurs. 

If'an electrochemical sensor detects NOS in low quantities or inside nor- 
mal gradients, it generates a weak current lower than 50 nA. 

In such cases, the nanorobot ignores the NOS concentration, assuming it 
as expected levels of intracranial NOS. However, if the NOS patterns reach 
concentration higher than 2 pL, it activates the embedded sensor, generating 
an electric current higher than 90 nA. Every time the activation of 
nanorobots takes place, an electromagnetic signal is back-propagated in 
the integrated system platform, which records the nanorobots’ positions 
at the time of the signal generation. Iflarge numbers of signals are generated, 
they indicate the early stages of brain aneurysm in the patient. It also informs 
the doctors about the location of the vessel bulb. The nanorobots provide 
their respective positions for the moment they detected a high concentration 
of NOS7. 

To escape noise distortions and achieve a higher resolution, the system 
studies a strong evidence of intracranial aneurysm every time it receives 
back-propagated signals from a total of 100 nanorobots. 





7 Medical application of nanorobots 


Nanorobots are expected to provide novel treatments for patients suf- 
fering from various diseases. The advancement will result in an astonishing 
improvement in the medical arena. Existing advances in bimolecular com- 
puting are a promising step towards a future of nanoprocessors of increased 
intricacy and capabilities. Studies meant at developing biosensors and 
nanokinetic devices required for medical nanorobotics operation and loco- 
motion is in progress. Application of nanorobots may boost biomedical 
involvement with slightly invasive surgeries. It will also help patients who 
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need continuous monitoring of body functions. Monitoring diabetes and 
controlling glucose levels for patients will be a possible application of 
nanorobots. It is also expected to improve the competence of treatments 
through early diagnosis of probable severe diseases. For instance, nanorobots 
may be utilized to attach on transmigrating inflammatory cells or white 
blood cells, thus reaching inflamed tissues faster to help in their healing pro- 
cess. Nanorobots could be used to process specific chemical reactions in the 
human body as auxiliary devices for wounded organs. Nanorobots will be 
useful in chemotherapy to fight cancer through specific chemical dosage 
administration. Similar drug delivery methodology can be adopted to allow 
nanorobots to deliver anti-HIV or any other drug. Nanorobots could be 
used to locate and destroy kidney stones. One significant application of med- 
ical nanorobots could be the potential to locate atherosclerotic lesions in 
stenos blood vessels, primarily in coronary circulation, and treat them either 
mechanically, chemically, or pharmacologically. 

Organic nanorobots that work on ATP and DNA-based molecular 
machines are also known as bio-nanorobots. The scheme is to develop 
ribonucleic acid and adenosine tri-phosphate devices. The usage of tailored 
microorganisms to achieve a bio-molecular computation, sensing, and actu- 
ation for nanorobots is also undergoing experiments. 

Substitute methods for the development of molecular machines are the 
inorganic nanorobots. Development of inorganic nanorobots is based on 
customized nanoelectronics. In comparison to bio-nanorobots, inorganic 
nanorobots could achieve a much higher intricacy of incorporated nanoscale 
components. Using new diamondoid rigid materials are a likely advance- 
ment that could help in developing new materials for inorganic nanorobots. 

The nano-build hardware integrated system is discussed here. It 
includes a combined set of modus operandi and new methodologies from 
nanotechnology targeted at mechanized manufacturing of nanorobots. It 
is used in 3D simulation and manufacturing design with integrated 
nanoelectronics. The challenge of manufacturing nanorobots perhaps will 
result from new methodologies in fabrication, computation, sensing, and 
manipulation. Real-time 3D prototyping apparatus are important in nano- 
technological developments. This is expected to have direct impact on 
implementation of new approaches in manufacturing techniques. Simula- 
tion can forecast the performance of new nanodevices. Moreover, it will 
also help nanomechatronics designs and in the test of control and automa- 
tion approaches. Here in this chapter, the focus is on the applications of 
nanorobots on cancer treatment and cerebral aneurysms. 
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8 Nanorobots in cancer treatment 


Nanorobots are expected to provide substantial improvements in 
medicine through the miniaturization from microelectronics to 
nanoelectronics (Freitas, 2003). Cancer can be treated effectively with cur- 
rent levels of medical technologies and therapy tools. Thus far, a crucial fac- 
tor in determining the likelihood of a patient with cancer surviving is early 
diagnosis. The treatment of cancer is reasonably successful when it is 
detected at least before the metastasis has begun. To achieve successful treat- 
ment for patients, professionally targeted drug delivery is also important to 
decrease the side effects from chemotherapy. Bearing in mind the capability 
of nanorobots to navigate as blood borne devices, nanorobots can help in 
targeted drug delivery. Nanorobots with implanted chemical biosensors 
could be used for detection of tumor cells at an early stage of tumor devel- 
opment in the patient’s body. Nanosensors integrated on the nanorobots can 
be used to find intensity of E-cadherin signals. Hardware-based architecture 
for nanobioelectronics is in developmental stage for function of nanorobots 
in cancer therapy. Analyses and termination for the proposed model have 
been obtained through real-time 3D simulations. 





9 Nanorobots in cerebral aneurysm 


Endovascular treatment of brain aneurysms, arteriovenous mal- 
formations, and arteriovenous fistulas are expected to gain assistance from 
present research and developments in medical nanorobotics (Drexler, 
1986). The first generation of nanotechnological prototypes of molecular 
machines are being examined and many encouraging device propulsion 
and sensing methodologies have been recognized (Asimov, 1966; 
Crichton, 2002). More complex molecular machines like nanorobots, hav- 
ing embedded nanoscopic tools for medical procedures (Sitti et al., 1998), 
are in the developmental phase. Sensors for biomedical applications are 
improving through teleoperated surgery and pervasive medicine (Drexler 
et al., 1991). The same technology provides the basis for manufacturing 
bimolecular actuators. These tools have pointedly helped the semiconductor 
industry to achieve faster VLSI developments (Ahuja et al., 2006). It may 
have a similar impact on the implementation of nanomanufacturing 
techniques, and on the progress of nanoelectronics. Simulation can foresee 
performance, help in device modeling, manufacturing analysis, 
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nanomechatronics control investigation (Drexler et al., 1991), and hardware 
designs. For analysis, a real-time simulation based on clinical data is useful, 
demonstrating sensor and nanorobot behavior capabilities for detection of 
abnormal vessel dilatation in cases of cerebral aneurysm (Weir et al., 2005). 





10 Conclusion 


This chapter discussed the developments in new manufacturing tech- 
nologies using nanotechnology because it is an investigative and treatment 
instrument for patients with cancer and cerebral aneurysm providing tailored 
treatments with better effectiveness and decreased side effects than those 
available today. Nano-medicine holds the promise to lead to an earlier diag- 
nosis, better therapy, and improved follow up care, making the healthcare 
more effective and affordable. This chapter also provided a summary of 
nanodevices and nanorobotics in medicine. It was a small subset of the mas- 
sive field of nanotechnology and nanobiotechnology. It is certainly possible 
that the use of nanorobotic technology will become ubiquitous in medicine 
within a generation. 





11 Forthcoming nanomedicine 


The arrival of molecular nanotechnology improves the effectiveness, 
comfort, and speed of forthcoming medical treatments. It will significantly 
reduce their risk, cost, and invasiveness. Nanotechnology can modify 
healthcare and human life more intensely than other developments. It is also 
contributing to shaping the modern industry, broadening the product devel- 
opment in pharma, biotech, diagnostic, and healthcare industries. Prospec- 
tive healthcare will make use of delicate diagnostics for upgraded health risk 
assessment. The maximum influence can be anticipated in cardiovascular 
diseases, cancer, musculoskeletal conditions, neurodegenerative and psychi- 
atric diseases, with the possibility for diabetes and viral infections to be cured 
with the application of nanotechnology. It will also lead to earlier diagnosis, 
better therapy, and improved follow-up care, making healthcare more effec- 
tive and affordable. This technology will also work innovatively in con- 
structing and employing nanorobots effectively for biomedical glitches. 
Applications of nanorobots in medicine holds a large number of promises 
from exterminating disease to retreating the ageing process (wrinkles, loss 
of bone mass, and age-related conditions are all treatable at the cellular level). 
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Nanomedicine will permit a more personalized treatment for countless 
ailments, by taking advantage of the in-depth understanding of diseases on a 
molecular level. Scientific researchers are on the verge of developing tech- 
nologies on a scale an order of magnitude smaller than ever before. With the 
advancement of technology, we will be able to achieve improved control of 
the world around us and ourselves. Developing the ability to operate the 
world on a smaller scale has brought revolutionary changes in the scientific 
discoveries and the world at large. Whether it was the age of microscopes 
accompanying in the range of bacteriology or commencement of the atomic 
age with the learning of particle physics, nanotechnology is certain to change 
many of the patterns with which we think about disease diagnosis, treat- 
ment, prevention, and screening related to healthcare. Nanorobotics is 
evolving extensive possible uses across all fields of medicine and growing 
the number of therapeutic options available, it is also improving the effec- 
tiveness of existing treatments. Nanotechnology will touch our lives in 
uncountable ways through industries such as telecommunications and agri- 
culture and more. 
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